LLM cost router for a SaaS application

A cost router selects a model using task requirements, latency and current vendor rates. Define a per-request budget, record actual usage and set a fallback policy. A cheaper model that fails the task can cost more after retries. Evaluate quality on representative examples before changing routes.