HAProxy's 200 ms LLM token delay is a smart default. Here's when to change it.

NOTE: I work at HAProxy, so I'm probably a bit biased. Still, this is an accurate look at the situation. A fun little deep dive, actually. Regardless, this is my own opinion/research, not official fro...