AI Systems Need Runtime Budgets

A five-second model timeout does not give you a five-second AI feature. Retrieval may take one second. The first model call takes four. A tool takes another two, and the next model call gets its own f...