mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Add ExLlamaV2 and ExLlamav2_HF loaders (#3881)

Browse source
This commit is contained in:
oobabooga 2023-09-12 14:33:07 -03:00 • committed by GitHub
parent a821928877
commit c2a309f56e
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
9 changed files with 295 additions and 5 deletions
Download patch file Download diff file Expand all files Collapse all files

2
models/config.yaml
View file

@ -210,7 +210,7 @@ llama-65b-gptq-3bit:
instruction_template: 'Alpaca'
.*llama-(2|v2):
truncation_length: 4096
.*llama-(2|v2).*chat:
.*llama(-?)(2|v2).*chat:
instruction_template: 'Llama-v2'
.*newhope:
instruction_template: 'NewHope'