mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

feature/docker_improvements (#4768)

Browse source
This commit is contained in:
Callum 2023-11-30 05:20:23 +00:00 • committed by GitHub
parent 2698d7c9fd
commit 88620c6b39
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
7 changed files with 90 additions and 97 deletions
Download patch file Download diff file Expand all files Collapse all files

8
README.md
View file

@ -163,14 +163,18 @@ The requirments*.txt above contain various precompiled wheels. If you wish to co
### Alternative: Docker
```
ln -s docker/{Dockerfile,docker-compose.yml,.dockerignore} .
ln -s docker/{nvidia/Dockerfile,docker-compose.yml} .
cp docker/.env.example .env
# Edit .env and set TORCH_CUDA_ARCH_LIST based on your GPU model
# Edit .env and set:
# TORCH_CUDA_ARCH_LIST based on your GPU model
# APP_RUNTIME_GID your host user's group id (run `id -g` in a terminal)
# BUILD_EXTENIONS optionally add comma separated list of extensions to build
docker compose up --build
```
* You need to have Docker Compose v2.17 or higher installed. See [this guide](https://github.com/oobabooga/text-generation-webui/wiki/09-%E2%80%90-Docker) for instructions.
* For additional docker files, check out [this repository](https://github.com/Atinoda/text-generation-webui-docker).
* Currently breaks GPTQ-for-Llama
### Updating the requirements