Vetch

Overview

Vetch is a tool designed for inference waste control in production LLM systems, automatically detecting and stopping stalled agents and runaway inference. It is ideal for developers and data scientists looking to optimize their machine learning workflows.