mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

New feature: "random preset" button (#4647)

Browse source
This commit is contained in:
oobabooga 2023-11-18 18:31:41 -03:00 • committed by GitHub
parent d1a58da52f
commit 83b64e7fc1
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
3 changed files with 51 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

8
docs/03 - Parameters Tab.md
View file

@ -11,9 +11,13 @@ LLMs work by generating one token at a time. Given your prompt, the model calcul
### Preset menu
Can be used to save combinations of parameters for reuse.
Can be used to save and load combinations of parameters for reuse.
The built-in presets were not manually chosen. They were obtained after a blind contest called "Preset Arena" where hundreds of people voted. The full results can be found [here](https://github.com/oobabooga/oobabooga.github.io/blob/main/arena/results.md).
* **🎲 button**: creates a random yet interpretable preset. Only 1 parameter of each category is included for the categories: removing tail tokens, avoiding repetition, and flattening the distribution. That is, top_p and top_k are not mixed, and neither are repetition_penalty and frequency_penalty. You can use this button to break out of a loop of bad generations after multiple "Regenerate" attempts.
#### Built-in presets
These were obtained after a blind contest called "Preset Arena" where hundreds of people voted. The full results can be found [here](https://github.com/oobabooga/oobabooga.github.io/blob/main/arena/results.md).
A key takeaway is that the best presets are: