Prompt Cache
Free232 GitHub stars
IntegrationAgnosticFile System
Overview
Prompt Cache is an intelligent semantic caching solution that significantly reduces LLM costs and enhances response times. It is designed for developers looking to optimize their language model interactions across various providers.