IPEX LLM
Free8.8k GitHub stars
Platform & FrameworkAgnosticFile System
Overview
IPEX LLM accelerates local LLM inference and finetuning on Intel hardware, making it ideal for developers working with large language models. It seamlessly integrates with popular frameworks like HuggingFace and LangChain, catering to AI practitioners looking for performance optimization.