Latency vs. Tokens: What I Learned Optimizing an Agent with Gemma (and What Didn't Work)

I'd been waiting for more than 30 minutes. The terminal just sat there, blinking, without returning a single word. I'd launched Gemma2 in its 9-billion-parameter version on my laptop (a regular Mac, t...