mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

8k size only for minotaur-15B (#2815)

Browse source 
Co-authored-by: Matthew Ashton <mashton-gitlab@zhero.org>
This commit is contained in:
matatonic 2023-06-24 09:14:19 -04:00 • committed by GitHub
parent 38897fbd8a
commit 8c36c19218
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

1
models/config.yaml
View file

@ -235,6 +235,7 @@ TheBloke_WizardLM-30B-GPTQ:
.*minotaur: .*minotaur:
mode: 'instruct' mode: 'instruct'
instruction_template: 'Minotaur' instruction_template: 'Minotaur'
.*minotaur-15b:
truncation_length: 8192 truncation_length: 8192
chat_prompt_size: 8192 chat_prompt_size: 8192
chat_prompt_size_max: 8192 chat_prompt_size_max: 8192