AgentStack
Back to directory

VLLM CLI

Free
497 GitHub stars
Agent ToolAgnosticFile System

Overview

VLLM CLI is a command-line interface tool designed for serving large language models (LLMs) efficiently. It is ideal for developers and data scientists looking to deploy LLMs in a streamlined manner.

Visit resource