Lorax

Overview

Lorax is a multi-LoRA inference server designed to efficiently scale to thousands of fine-tuned large language models. It is ideal for developers and researchers looking to deploy and manage multiple LLMs seamlessly.