mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Dynamic Temperature HF loader support (#5174)

Browse source 
---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
This commit is contained in:
kalomaze 2024-01-07 07:36:26 -06:00 • committed by GitHub
parent 3eca20c015
commit 48327cc5c4
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
14 changed files with 184 additions and 8 deletions
Download patch file Download diff file Expand all files Collapse all files

3
modules/loaders.py
View file

@ -155,6 +155,7 @@ def transformers_samplers():
return {
'temperature',
'temperature_last',
'dynatemp',
'top_p',
'min_p',
'top_k',
@ -220,6 +221,7 @@ loaders_samplers = {
'ExLlamav2_HF': {
'temperature',
'temperature_last',
'dynatemp',
'top_p',
'min_p',
'top_k',
@ -272,6 +274,7 @@ loaders_samplers = {
'llamacpp_HF': {
'temperature',
'temperature_last',
'dynatemp',
'top_p',
'min_p',
'top_k',