mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Implement CPU mode

Browse source
This commit is contained in:
oobabooga 2023-01-09 10:58:46 -03:00
parent f2a548c098
commit 0e67ccf607
2 changed files with 31 additions and 14 deletions
Download patch file Download diff file Expand all files Collapse all files

3
README.md
View file

@ -15,6 +15,7 @@ Its goal is to become the [AUTOMATIC1111/stable-diffusion-webui](https://github.
* Chat mode for conversation and role playing.
* Load 13b/20b models in 8-bit mode.
* Load parameter presets from text files.
* Option to use the CPU instead of the GPU for generation.
## Installation
@ -89,6 +90,8 @@ Optionally, you can use the following command-line flags:
`--chat`: Launch the webui in chat mode.
`--cpu`: Use the CPU to generate text instead of the GPU.
## Presets
Inference settings presets can be created under `presets/` as text files. These files are detected automatically at startup.