Маршрутизатор моделей — компонент, направляющий запрос к наиболее подходящей модели на основе task type, cost, latency, capability, risk или availability. Routing может поддерживать model cascading, fallback strategies и multi-model orchestration.
The algorithm that determines the ideal model for inference in model cascading. A model router is itself typically a machine learning model that gradually learns how to pick the best model for a given input. However, a model router could sometimes be a simpler, non-machine learning algorithm.