mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Bump exllamav2 to 0.0.12 (#5352)

Browse source
This commit is contained in:
oobabooga 2024-01-22 22:40:12 -03:00 • committed by GitHub
parent aa575119e6
commit 87dc421ee8
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
11 changed files with 45 additions and 31 deletions
Download patch file Download diff file Expand all files Collapse all files

4
modules/loaders.py
View file

@ -205,12 +205,16 @@ loaders_samplers = {
'HQQ': transformers_samplers(),
'ExLlamav2': {
'temperature',
'temperature_last',
'top_p',
'min_p',
'top_k',
'typical_p',
'tfs',
'top_a',
'repetition_penalty',
'presence_penalty',
'frequency_penalty',
'repetition_penalty_range',
'seed',
'mirostat_mode',