mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

[OpenAI Extension] Add 'max_logits' parameter in logits endpoint (#4916)

Browse source
This commit is contained in:
Kim Jaewon 2023-12-15 12:22:43 +09:00 • committed by GitHub
parent eaa1fe67f3
commit e53f99faa0
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
3 changed files with 8 additions and 6 deletions
Download patch file Download diff file Expand all files Collapse all files

2
extensions/openai/logits.py
View file

@ -8,4 +8,4 @@ def _get_next_logits(body):
state = process_parameters(body) if use_samplers else {}
state['stream'] = True
return get_next_logits(body['prompt'], state, use_samplers, "", return_dict=True)
return get_next_logits(body['prompt'], state, use_samplers, "", top_logits=body['top_logits'], return_dict=True)