Set use_fast=True by default, create --no_use_fast flag

This increases tokens/second for HF loaders.
2023-11-16 19:45:05 -08:00 · 2023-11-16 19:45:05 -08:00 · 8b66d83aa9
commit 8b66d83aa9
parent b2ce8dc7ee
6 changed files with 20 additions and 19 deletions
--- a/modules/ui.py
+++ b/modules/ui.py
@ -52,7 +52,7 @@ def list_model_elements():
        'bf16',
        'load_in_8bit',
        'trust_remote_code',
-        'use_fast',
+        'no_use_fast',
        'use_flash_attention_2',
        'load_in_4bit',
        'compute_dtype',