Add --cai-chat option that mimics Character.AI's interface

This commit is contained in:
oobabooga 2023-01-15 12:20:04 -03:00
parent d0af274185
commit 6136da419c
3 changed files with 136 additions and 9 deletions

View file

@ -125,6 +125,9 @@ Optionally, you can use the following command-line flags:
--notebook Launch the webui in notebook mode, where the output is written to the same text
box as the input.
--chat Launch the webui in chat mode.
--cai-chat Launch the webui in chat mode with a style similar to Character.AI's. If the
file profile.png exists in the same folder as server.py, this image will be used
as the bot's profile picture.
--cpu Use the CPU to generate text.
--auto-devices Automatically split the model across the available GPU(s) and CPU.
--load-in-8bit Load the model with 8-bit precision.