Caesar AI Atlas

Model Router

Caesar AI Atlas Definition

A model router is a component that directs a request to the most appropriate model based on factors such as task type, cost, latency, capability, risk, or availability. Routing can support model cascading, fallback strategies, and multi-model orchestration.

Other Definitions

Model Router Source

The algorithm that determines the ideal model for inference in model cascading. A model router is itself typically a machine learning model that gradually learns how to pick the best model for a given input. However, a model router could sometimes be a simpler, non-machine learning algorithm.

Related Terms