AutoGPTQ API
Free91 GitHub stars
Platform & FrameworkAgnosticFile System
Overview
AutoGPTQ API allows users to host the GPTQ model for text generation through a compatible API. It is designed for developers looking to integrate advanced text generation capabilities into their applications.