mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Add AMD GPU support for Linux (#98)

Browse source
This commit is contained in:
jllllll 2023-07-26 15:33:02 -05:00 • committed by GitHub
parent 52e3b91f5e
commit 1e3c950c7d
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 79 additions and 32 deletions
Download patch file Download diff file Expand all files Collapse all files

9
INSTRUCTIONS.TXT
View file

@ -28,3 +28,12 @@ CMD_FLAGS = '--chat --api'
To run an interactive shell in the miniconda environment, run the "cmd"
script. This is useful for installing additional requirements manually.
# Using an AMD GPU in Linux
Requires ROCm SDK 5.4.2 or 5.4.3 to be installed.
Some systems may also need: sudo apt-get install libstdc++-12-dev
Edit the "webui.py" script using a text editor and un-comment and modify the
lines near the top of the script according to your setup. In particular, modify
the os.environ["ROCM_PATH"] = '/opt/rocm' line to point to your ROCm installation.