Open LLM Server
Free21 GitHub stars
Platform & FrameworkAgnosticFile System
Overview
Open LLM Server provides a flexible framework for serving endpoints for embeddings and chat completions using state-of-the-art open source language models. It is ideal for developers looking to implement various natural language processing tasks via simple HTTP endpoints.