Paddler

Overview

Paddler is an open-source load balancer and serving platform designed for self-hosting large language models (LLMs) and vision language models (VLMs) at scale. It simplifies deployments with fewer moving parts, making it ideal for developers looking to efficiently manage LLMs in various environments.