Overview
BentoML provides model packaging, service orchestration, inference APIs, containerization, and cloud-native deployment for shipping ML models and LLM applications to production.
Features
- Model packaging
- API serving
- Cloud-native deployment
BentoML provides model packaging, service orchestration, inference APIs, containerization, and cloud-native deployment for shipping ML models and LLM applications to production.