mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Automatically set wbits/groupsize/instruct based on model name (#1167)

Browse source
This commit is contained in:
oobabooga 2023-04-14 11:07:28 -03:00 • committed by GitHub
parent 9d66957207
commit 8e31f2bad4
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
7 changed files with 377 additions and 286 deletions
Download patch file Download diff file Expand all files Collapse all files

1
settings-template.json
View file

@ -16,6 +16,7 @@
"truncation_length_min": 0,
"truncation_length_max": 4096,
"mode": "cai-chat",
"instruction_template": "None",
"chat_prompt_size": 2048,
"chat_prompt_size_min": 0,
"chat_prompt_size_max": 2048,