Reduce an LLM API Bill for SaaS: Prompt Routing, Fallbacks, and Batch Processing

TL;DR Route narrow, testable prompts to a small model first, fall back to a large model only on an explicit quality signal, and move delay-tolerant work into a batch lane. The cheapest architecture fo...