mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Change rms_norm_eps to 5e-6 for llama-2-70b ggml

Browse source 
Based on https://github.com/ggerganov/llama.cpp/pull/2384
This commit is contained in:
oobabooga 2023-07-25 14:54:57 -07:00
parent ef8637e32d
commit 7bc408b472
2 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
models/config.yaml
View file

@ -279,4 +279,4 @@ TheBloke_WizardLM-30B-GPTQ:
instruction_template: 'Llama-v2'
.*llama.*70b.*ggml.*\.bin:
n_gqa: 8
rms_norm_eps: 1.0e-5
rms_norm_eps: 5.0e-6