mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Add max_tokens_second param (#3533)

Browse source
This commit is contained in:
oobabooga 2023-08-29 17:44:31 -03:00 • committed by GitHub
parent fe1f7c6513
commit cec8db52e5
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
11 changed files with 24 additions and 3 deletions
Download patch file Download diff file Expand all files Collapse all files

1
settings-template.yaml
View file

@ -17,6 +17,7 @@ truncation_length_min: 0
truncation_length_max: 16384
custom_stopping_strings: ''
auto_max_new_tokens: false
max_tokens_second: 0
ban_eos_token: false
add_bos_token: true
skip_special_tokens: true