mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Update docs

Browse source
This commit is contained in:
oobabooga 2023-07-31 19:20:33 -07:00
parent f094330df0
commit b2207f123b
3 changed files with 0 additions and 38 deletions
Download patch file Download diff file Expand all files Collapse all files

35
docs/Generation-parameters.md
View file

@ -1,35 +0,0 @@
# Generation parameters
For a description of the generation parameters provided by the transformers library, see this link: https://huggingface.co/docs/transformers/main_classes/text_generation#transformers.GenerationConfig
### llama.cpp
llama.cpp only uses the following parameters:
* temperature
* top_p
* top_k
* repetition_penalty
* tfs
* mirostat_mode
* mirostat_tau
* mirostat_eta
### ExLlama
ExLlama only uses the following parameters:
* temperature
* top_p
* top_k
* repetition_penalty
* repetition_penalty_range
* typical_p
### RWKV
RWKV only uses the following parameters when loaded through the old .pth weights:
* temperature
* top_p
* top_k

1
docs/README.md
View file

@ -8,7 +8,6 @@
* [Docker](Docker.md)
* [ExLlama](ExLlama.md)
* [Extensions](Extensions.md)
* [Generation parameters](Generation-parameters.md)
* [GPTQ models (4 bit mode)](GPTQ-models-(4-bit-mode).md)
* [LLaMA model](LLaMA-model.md)
* [llama.cpp](llama.cpp.md)