Hopiu/llm
1
0
Fork 0
mirror of https://github.com/Hopiu/llm.git synced 2026-04-18 04:01:02 +00:00
Code Issues Projects Releases Packages Wiki Activity Actions

Serialize usage to JSON properly, closes #614

Browse source
This commit is contained in:
Simon Willison 2024-11-06 03:27:25 -08:00
parent 245e025270
commit 3352eb9f57
1 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
llm/default_plugins/openai_models.py
View file

@ -514,7 +514,7 @@ def combine_chunks(chunks: List) -> dict:
for item in chunks:
if item.usage:
usage = dict(item.usage)
usage = item.usage.dict()
for choice in item.choices:
if choice.logprobs and hasattr(choice.logprobs, "top_logprobs"):
logprobs.append(