text-generation-webui/docs/README.md

text-generation-webui documentation

Table of contents

• GPTQ models (4 bit mode)
• LLaMA model
• Using LoRAs
• llama.cpp models
• RWKV model
• Generation parameters
• Extensions
• Chat mode
• DeepSpeed
• FlexGen
• Spell book
• Low-VRAM-guide
• System requirements
• Windows installation guide
• WSL installation guide
• Docker Compose
• Audio notification
• Performance optimizations