mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Rename additive_repetition_penalty to presence_penalty, add frequency_penalty (#4376)

Browse source
This commit is contained in:
tdrussell 2023-10-25 10:10:28 -05:00 • committed by GitHub
parent ef1489cd4d
commit 72f6fc6923
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
14 changed files with 64 additions and 30 deletions
Download patch file Download diff file Expand all files Collapse all files

2
modules/llamacpp_model.py
View file

@ -146,6 +146,8 @@ class LlamaCppModel:
top_p=state['top_p'],
top_k=state['top_k'],
repeat_penalty=state['repetition_penalty'],
presence_penalty=state['presence_penalty'],
frequency_penalty=state['frequency_penalty'],
tfs_z=state['tfs'],
mirostat_mode=int(state['mirostat_mode']),
mirostat_tau=state['mirostat_tau'],