mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Replace --mul_mat_q with --no_mul_mat_q

Browse source
This commit is contained in:
oobabooga 2023-10-22 12:22:06 -07:00
parent d0c3b407b3
commit df90d03e0b
9 changed files with 12 additions and 11 deletions
Download patch file Download diff file Expand all files Collapse all files

4
modules/loaders.py
View file

@ -94,7 +94,7 @@ loaders_and_params = OrderedDict({
'threads_batch',
'no_mmap',
'mlock',
'mul_mat_q',
'no_mul_mat_q',
'llama_cpp_seed',
'alpha_value',
'rope_freq_base',
@ -111,7 +111,7 @@ loaders_and_params = OrderedDict({
'threads_batch',
'no_mmap',
'mlock',
'mul_mat_q',
'no_mul_mat_q',
'alpha_value',
'rope_freq_base',
'compress_pos_emb',