Falcon support (trust-remote-code and autogptq checkboxes) (#2367)

---------

Co-authored-by: oobabooga <112222186+oobabooga@users.noreply.github.com>
This commit is contained in:
Honkware 2023-05-29 08:20:18 -05:00 committed by GitHub
parent 60ae80cf28
commit 204731952a
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
6 changed files with 9 additions and 5 deletions

View file

@ -35,6 +35,7 @@ def load_quantized(model_name):
'device': "cuda:0" if not shared.args.cpu else "cpu",
'use_triton': shared.args.triton,
'use_safetensors': use_safetensors,
'trust_remote_code': shared.args.trust_remote_code,
'max_memory': get_max_memory_dict()
}