FastDeploy
Free3.7k GitHub stars
Platform & FrameworkAgnosticFile System
Overview
FastDeploy is a high-performance inference and deployment toolkit designed for large language models (LLMs) and vision-language models (VLMs). It is ideal for developers and researchers looking to efficiently deploy AI models using PaddlePaddle.