OSS LLM Benchmark Tool

Overview

This tool benchmarks the inference time and token count for open-source language models using Ollama. It is designed for developers and researchers looking to evaluate the performance of various LLMs.