Local Inference Calculator

Overview

Local Inference Calculator is a CLI tool designed to estimate VRAM requirements for large language models across various GPUs. It is ideal for developers and researchers working with machine learning models who need to optimize their hardware configurations.