I measured every millisecond of my real-time AI pipeline. The LLM was the fast part.

I'm building LiveSuggest, a real-time meeting assistant. It listens to your call and shows you written suggestions while you're still talking: a clarifying question to ask, a point you forgot to make,...