ai_ml_operations/chat_backend
2
0
Fork 0
Code Issues 23 Pull Requests Actions Packages Projects Releases Wiki Activity

Persist Ollama token usage from streamed LLM responses (#16) #38

Merged
westfarn merged 1 commits from fix/persist-stream-token-usage into master 2026-07-31 10:46:57 -07:00
Conversation 0 Commits 1 Files Changed 7
+139 -22
1 Commits
Author SHA1 Message Date
westfarn 3892bc3224 Persist Ollama token usage from streamed LLM responses (#16)
CI / test (pull_request) Successful in 10s
Details
Unit Tests / test (pull_request) Successful in 10s
Details 
Streaming dropped provider usage (StrOutputParser + None extract path), so PromptMetric tokens_in/out stayed null. Capture generation_info while streaming and stop double-closing websockets.
 2026-07-31 09:29:14 -05:00