ended7월 26일· 1 sources
We Got the Prompt Cache Working. Our Pipeline Got Slower.
Why it matters
"You're spawning a fresh codex exec for every single call? Just run the app-server and reuse a thread. The prompt cache alone will pay for it." That sentence sounds so obviously right that nobody ever...
1
Sources
+0
24h
—
Growth
57d
Active