VLLM CLI
Free497 GitHub stars
Agent ToolAgnosticFile System
Overview
VLLM CLI is a command-line interface tool designed for serving large language models (LLMs) efficiently. It is ideal for developers and data scientists looking to deploy LLMs in a streamlined manner.