mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Add rope_freq_base parameter for CodeLlama

Browse source
This commit is contained in:
oobabooga 2023-08-25 06:53:37 -07:00
parent feecd8190f
commit 52ab2a6b9e
10 changed files with 26 additions and 17 deletions
Download patch file Download diff file Expand all files Collapse all files

3
modules/ui.py
View file

@ -79,7 +79,8 @@ def list_model_elements():
'gpu_split',
'max_seq_len',
'compress_pos_emb',
'alpha_value'
'alpha_value',
'rope_freq_base'
]
for i in range(torch.cuda.device_count()):