Ollama API Compatible Server

Overview

This tool provides an Ollama API-compatible server for running local LLM inference using your own GGUF models. It is designed for developers looking to integrate with existing tools and applications that utilize the Ollama API.