mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Refactor models.py (#2113)

Browse source
This commit is contained in:
oobabooga 2023-05-16 19:52:22 -03:00 • committed by GitHub
parent 5cd6dd4287
commit 7584d46c29
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
3 changed files with 126 additions and 102 deletions
Download patch file Download diff file Expand all files Collapse all files

3
docs/DeepSpeed.md
View file

@ -9,7 +9,8 @@ As far as I know, DeepSpeed is only available for Linux at the moment.
1. Install DeepSpeed:
```
pip install deepspeed
conda install -c conda-forge mpi4py mpich
pip install -U deepspeed
```
2. Start the web UI replacing `python` with `deepspeed --num_gpus=1` and adding the `--deepspeed` flag. Example: