Distributed Llama
Free2.9k GitHub stars
Platform & FrameworkAgnosticFile System
Overview
Distributed Llama enables users to connect home devices into a powerful cluster for accelerated LLM inference. This tool is ideal for developers and researchers looking to enhance the performance of their language models using distributed computing.