GPU Poor
Free1.4k GitHub stars
Agent ToolAgnosticFile System
Overview
GPU Poor is a utility that calculates token/s and GPU memory requirements for various large language models. It is designed for developers and researchers working with LLMs who need to optimize their resource usage.