AI Definitions: Model Routing
/Model Routing – Using a small piece of code (router) to match AI tasks to the cheapest capable model. By sending only the most demanding prompts to the most expensive LLMs, most traffic will run on lower-cost local models. Some premium AI providers consider it an existential threat to their business model.