mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Add low vram mode on llama cpp (#3076)

Browse source
This commit is contained in:
Gabriel Pena 2023-07-12 11:05:13 -03:00 • committed by GitHub
parent 180420d2c9
commit eedb3bf023
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
5 changed files with 5 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
modules/ui.py
View file

@ -57,6 +57,7 @@ def list_model_elements():
'threads',
'n_batch',
'no_mmap',
'low_vram',
'mlock',
'n_gpu_layers',
'n_ctx',