Your compiled DSPy program re-sends up to 20 few-shot demos on every single call

DSPy's pitch is that you stop hand-writing prompts and let an optimizer compile them for you. You write a program out of modules, hand it a metric and a trainset, run a teleprompter, and it finds good...