AgentStack
Back to directory

Llama 2 Open Source LLM CPU Inference

Free
974 GitHub stars
Agent ToolLlamaIndexFile System

Overview

This tool enables users to run Llama 2 and other open-source large language models on local CPU for document question and answer tasks. It is designed for developers and researchers looking to leverage LLMs without the need for GPU resources.

Visit resource
Connect Llama 2 Open Source LLM CPU Inference to Local OS / File System | AgentStack