ended8월 27일· 1 sources
cached_tokens is 0 because your system prompt isn't stable
Why it matters
I added a [cache] log line next to our usage tracker and read usage.prompt_tokens_details.cached_tokens off a warm conversation. It said 0 . Then 1 . Out of roughly 16,000 prompt tokens, every single ...
1
Sources
+0
24h
—
Growth
25d
Active