mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Organize the CMD arguments by group (#5027)

Browse source
This commit is contained in:
oobabooga 2023-12-21 00:33:55 -03:00 • committed by GitHub
parent c727a70572
commit 2706149c65
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 120 additions and 102 deletions
Download patch file Download diff file Expand all files Collapse all files

2
README.md
View file

@ -237,7 +237,7 @@ List of command-line flags
| `--no_use_fast` | Set use_fast=False while loading the tokenizer (it's True by default). Use this if you have any problems related to use_fast. |
| `--use_flash_attention_2` | Set use_flash_attention_2=True while loading the model. |
#### Accelerate 4-bit
#### bitsandbytes 4-bit
⚠️ Requires minimum compute of 7.0 on Windows at the moment.