mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Implement default settings customization using a json file

Browse source
This commit is contained in:
oobabooga 2023-01-15 15:23:41 -03:00
parent cf0cdae9c6
commit 88d67427e1
3 changed files with 72 additions and 32 deletions
Download patch file Download diff file Expand all files Collapse all files

27
README.md
View file

@ -120,18 +120,21 @@ Then browse to
Optionally, you can use the following command-line flags:
```
-h, --help show this help message and exit
--model MODEL Name of the model to load by default.
--notebook Launch the webui in notebook mode, where the output is written to the same text
box as the input.
--chat Launch the webui in chat mode.
--cai-chat Launch the webui in chat mode with a style similar to Character.AI's. If the
file profile.png exists in the same folder as server.py, this image will be used
as the bot's profile picture.
--cpu Use the CPU to generate text.
--auto-devices Automatically split the model across the available GPU(s) and CPU.
--load-in-8bit Load the model with 8-bit precision.
--no-listen Make the webui unreachable from your local network.
-h, --help show this help message and exit
--model MODEL Name of the model to load by default.
--settings-file SETTINGS_FILE
Load default interface settings from this json file. See settings-
template.json for an example.
--notebook Launch the webui in notebook mode, where the output is written to the same
text box as the input.
--chat Launch the webui in chat mode.
--cai-chat Launch the webui in chat mode with a style similar to Character.AI's. If
the file profile.png exists in the same folder as server.py, this image
will be used as the bot's profile picture.
--cpu Use the CPU to generate text.
--auto-devices Automatically split the model across the available GPU(s) and CPU.
--load-in-8bit Load the model with 8-bit precision.
--no-listen Make the webui unreachable from your local network.
```
## Presets