Bench My LLM

Overview

Bench My LLM is a command-line interface tool designed for benchmarking large language models by measuring latency, cost, and quality metrics. It is ideal for developers and researchers looking to evaluate the performance of their LLMs effectively.