Node Llama CPP
Free2.1k GitHub stars
Agent ToolLlamaIndexFile System
Overview
Node Llama CPP allows developers to run AI models locally using Node.js bindings for llama.cpp, providing flexibility in model output through JSON schema enforcement. This tool is ideal for developers looking to integrate AI capabilities into their applications without relying on cloud services.