mmarch/text-generation-webui
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

Add back low_cpu_mem_usage=True

Browse source 
Removing it didn't help with anything, so I am adding it bad on a purely
superstiticious basis.
This commit is contained in:
oobabooga 2023-02-01 10:01:44 -03:00
parent d4a0b377ab
commit 119be56390
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
server.py
View file

@ -88,7 +88,7 @@ def load_model(model_name):
# Custom # Custom
else: else:
command = "AutoModelForCausalLM.from_pretrained" command = "AutoModelForCausalLM.from_pretrained"
settings = [] settings = ["low_cpu_mem_usage=True"]
if args.cpu: if args.cpu:
settings.append("low_cpu_mem_usage=True") settings.append("low_cpu_mem_usage=True")