KServe

Overview

KServe is a standardized platform for scalable, multi-framework deployment of generative and predictive AI inference on Kubernetes. It is designed for data scientists and ML engineers looking to serve models efficiently in production environments.