Model Management and Inference Model Management & Inference 1 of 49 in this book · 1 min read Scope: model selection, serving, and inference. Capabilities: 12 # Capability 1 Multi-model Support 2 Model Gateway 3 Model Routing 4 Model Fallback 5 Model Versioning 6 Inference Configuration 7 Model Capability Registry 8 Token Budget Management 9 Semantic Caching 10 Local and Self-hosted Inference 11 Embedding and Reranking Models 12 Model Benchmarking