Document logits_all
This commit is contained in:
parent
5c0559da69
commit
322c170566
2 changed files with 5 additions and 0 deletions
|
@ -110,6 +110,10 @@ To use it, you need to download a tokenizer. There are two options:
|
|||
1) Download `oobabooga/llama-tokenizer` under "Download model or LoRA". That's a default Llama tokenizer.
|
||||
2) Place your .gguf in a subfolder of `models/` along with these 3 files: `tokenizer.model`, `tokenizer_config.json`, and `special_tokens_map.json`. This takes precedence over Option 1.
|
||||
|
||||
It has an additional parameter:
|
||||
|
||||
* **logits_all**: Needs to be checked if you want to evaluate the perplexity of the llama.cpp model using the "Training" > "Perplexity evaluation" tab. Otherwise, leave it unchecked, as it makes prompt processing slower.
|
||||
|
||||
### ctransformers
|
||||
|
||||
Loads: GGUF/GGML models.
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue