Audience

Developers and professionals searching for a model inference platform on Kubernetes

About KServe

Highly scalable and standards-based model inference platform on Kubernetes for trusted AI. KServe is a standard model inference platform on Kubernetes, built for highly scalable use cases. Provides performant, standardized inference protocol across ML frameworks. Support modern serverless inference workload with autoscaling including a scale to zero on GPU. Provides high scalability, density packing, and intelligent routing using ModelMesh. Simple and pluggable production serving for production ML serving including prediction, pre/post-processing, monitoring, and explainability. Advanced deployments with the canary rollout, experiments, ensembles, and transformers. ModelMesh is designed for high-scale, high-density, and frequently-changing model use cases. ModelMesh intelligently loads and unloads AI models to and from memory to strike an intelligent trade-off between responsiveness to users and computational footprint.

Pricing

Starting Price:
Free
Free Version:
Free Version available.

Integrations

API:
Yes, KServe offers API access

Ratings/Reviews

Overall 0.0 / 5
ease 0.0 / 5
features 0.0 / 5
design 0.0 / 5
support 0.0 / 5

This software hasn't been reviewed yet. Be the first to provide a review:

Review this Software

Company Information

KServe
kserve.github.io/website/latest/

Videos and Screen Captures

KServe Screenshot 1
Other Useful Business Software
$300 Free Credits to Build on Google Cloud Icon
$300 Free Credits to Build on Google Cloud

New customers can spin up VMs, build with AI, and query data at no cost.

Put your $300 in credit toward real workloads, then keep building with free monthly usage for 20+ products. No commitment and no charge until you upgrade.
Start Free

Product Details

Platforms Supported
Windows
Mac
Linux
Training
Documentation
Support
Online

KServe Frequently Asked Questions

Q: What kinds of users and organization types does KServe work with?
KServe works with these users and organization types: Mid Size Business, Small Business, Enterprise, Freelance, Nonprofit, Government, and Startup.
Q: What languages does KServe support in their product?
KServe supports these languages: English.
Q: What kind of support options does KServe offer?
KServe offers support via online.
Q: What other applications or services does KServe integrate with?
KServe integrates with: Bloomberg, Docker, Gojek, IBM Cloud, Kubeflow, Kubernetes, NAVER, NVIDIA DRIVE, vLLM, ZenML, and Zillow.
Q: Does KServe have an API?
Yes, KServe has an API.
Q: What type of training does KServe provide?
KServe provides training in the form of documentation.
Q: How much does KServe cost?
Pricing for KServe starts at Free.

KServe Product Features

Machine Learning

Deep Learning Not Supported
ML Algorithm Library Not Supported
Model Training Not Supported
Natural Language Processing (NLP) Not Supported
Predictive Modeling Not Supported
Templates Not Supported
Visualization Not Supported
Statistical / Mathematical Tools Not Supported

KServe Additional Categories