mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Use oasst tokenizer instead of universal tokenizer

Browse source
This commit is contained in:
oobabooga 2023-05-04 15:55:39 -03:00
parent b6ff138084
commit 97a6a50d98
2 changed files with 3 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

1
models/config.yaml
View file

@ -24,7 +24,6 @@ llama-[0-9]*b-4bit$:
.*(oasst-sft-1-pythia-12b|oasst-sft-6-llama-30b):
mode: 'instruct'
instruction_template: 'Open Assistant'
custom_stopping_strings: '"<|endoftext|>"'
.*vicuna:
mode: 'instruct'
instruction_template: 'Vicuna-v0'