Add penalty_alpha parameter (contrastive search)

This commit is contained in:
oobabooga 2023-02-11 14:48:12 -03:00
parent 8aafb55693
commit 0dd1409f24
3 changed files with 31 additions and 22 deletions

5
presets/Instruct-Joi.txt Normal file
View file

@ -0,0 +1,5 @@
top_p=0.95,
temperature=0.5,
penalty_alpha=0.6,
top_k=4,
repetition_penalty=1.03,