AgentStack
Back to directory

Distributed Llama

Free
2.9k GitHub stars
Platform & FrameworkAgnosticFile System

Overview

Distributed Llama enables users to connect home devices into a powerful cluster for accelerated LLM inference. This tool is ideal for developers and researchers looking to enhance the performance of their language models using distributed computing.

Visit resource