Structured Output From LLMs: A Retry-Repair Loop Your Parser Never Sees Through

The first time I wired an LLM into a real product feature at Shpper, I did the naive thing: prompt the model to "return JSON", jsonDecode the response, move on. It worked in the demo. Then it hit real...