AgentStack
Back to directory

Distributed Llama

Free
2.9k GitHub stars
Platform & FrameworkAgnosticFile System

Overview

Distributed Llama enables users to connect home devices into a powerful cluster for accelerated LLM inference. This tool is ideal for developers and researchers looking to enhance the performance of their language models using distributed computing.

Visit resource
Connect Distributed Llama to Local OS / File System | AgentStack