Litellm

Overview

Litellm is a Python SDK and proxy server that enables seamless access to over 100 LLM APIs in a unified format, complete with features like cost tracking and load balancing. It is designed for developers looking to integrate multiple AI services efficiently and effectively.