Add mirostat parameters for llama.cpp (#2287)
This commit is contained in:
parent
ec7437f00a
commit
c0fd7f3257
13 changed files with 80 additions and 15 deletions
23
docs/Generation-parameters.md
Normal file
23
docs/Generation-parameters.md
Normal file
|
|
@ -0,0 +1,23 @@
|
|||
# Generation parameters
|
||||
|
||||
For a description of the generation parameters provided by the transformers library, see this link: https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.GenerationConfig
|
||||
|
||||
### llama.cpp
|
||||
|
||||
llama.cpp only uses the following parameters:
|
||||
|
||||
* temperature
|
||||
* top_p
|
||||
* top_k
|
||||
* repetition_penalty
|
||||
* mirostat_mode
|
||||
* mirostat_tau
|
||||
* mirostat_eta
|
||||
|
||||
### RWKV
|
||||
|
||||
RWKV only uses the following parameters:
|
||||
|
||||
* temperature
|
||||
* top_p
|
||||
* top_k
|
||||
Loading…
Add table
Add a link
Reference in a new issue