text-generation-webui

mmarch/text-generation-webui

Fork 0

Commit graph

def97f658c Small patch to fix loading of character jsons. Now it correctly reads non-ascii characters on Windows. HideLord 2023-03-12 02:54:22 +02:00
92fe947721 Merge branch 'main' into new-streaming oobabooga 2023-03-11 19:59:45 -03:00
195e99d0b6 Add llama_prompts extension oobabooga 2023-03-11 16:11:15 -03:00
501afbc234 Add requests to requirements.txt oobabooga 2023-03-11 14:47:30 -03:00
8f8da6707d Minor style changes to silero_tts oobabooga 2023-03-11 11:17:13 -03:00
2743dd736a Add *Is typing...* to impersonate as well oobabooga 2023-03-11 10:50:18 -03:00
96c51973f9 --auto-launch and "Is typing..." Xan 2023-03-11 22:50:59 +11:00
33df4bd91f Merge remote-tracking branch 'upstream/main' Xan 2023-03-11 22:40:47 +11:00
b8f7d34c1d Undo changes to requirements Xan 2023-03-11 17:05:09 +11:00
0dfac4b777 Working html autoplay, clean up, improve wav naming Xan 2023-03-11 16:34:59 +11:00
28fd4fc970 Change wording to be consistent with other args draff 2023-03-10 23:34:13 +00:00
001e638b47 Make it actually work draff 2023-03-10 23:28:19 +00:00
804486214b Re-implement --load-in-4bit and update --llama-bits arg description draff 2023-03-10 23:21:01 +00:00
9ba8156a70

remove unnecessary Path() ItsLogic 2023-03-10 22:33:58 +00:00
e6c631aea4 Replace --load-in-4bit with --llama-bits draff 2023-03-10 21:36:45 +00:00
026d60bd34 Remove default preset that didn't do anything oobabooga 2023-03-10 14:01:02 -03:00
e01da4097c

Merge pull request #210 from rohvani/pt-path-changes oobabooga 2023-03-10 11:04:56 -03:00
e9dbdafb14

Merge branch 'main' into pt-path-changes oobabooga 2023-03-10 11:03:42 -03:00
706a03b2cb Minor changes oobabooga 2023-03-10 11:02:25 -03:00
de7dd8b6aa Add comments oobabooga 2023-03-10 10:54:08 -03:00
113b791aa5

Merge pull request #219 from deepdiffuser/4bit-multigpu oobabooga 2023-03-10 10:52:45 -03:00
e461c0b7a0 Move the import to the top oobabooga 2023-03-10 10:51:12 -03:00
9fbd60bf22 add no_split_module_classes to prevent tensor split error deepdiffuser 2023-03-10 05:30:47 -08:00
ab47044459 add multi-gpu support for 4bit gptq LLaMA deepdiffuser 2023-03-10 04:29:09 -08:00
1c0bda33fb added installation instructions EliasVincent 2023-03-10 11:47:16 +01:00
2ac2913747 fix reference issue rohvani 2023-03-09 20:13:23 -08:00
1d7e893fa1

Merge pull request #211 from zoidbb/add-tokenizer-to-hf-downloads oobabooga 2023-03-10 00:46:21 -03:00
875847bf88 Consider tokenizer a type of text oobabooga 2023-03-10 00:45:28 -03:00
8ed214001d Merge branch 'main' of github.com:oobabooga/text-generation-webui oobabooga 2023-03-10 00:42:09 -03:00
249c268176 Fix the download script for long lists of files on HF oobabooga 2023-03-10 00:41:10 -03:00
ec3de0495c download tokenizer when present Ber Zoidberg 2023-03-09 19:08:09 -08:00
5ee376c580 add LLaMA preset rohvani 2023-03-09 18:31:41 -08:00
826e297b0e add llama-65b-4bit support & multiple pt paths rohvani 2023-03-09 18:31:32 -08:00
7c3d1b43c1

Merge pull request #204 from MichealC0/patch-1 oobabooga 2023-03-09 23:04:09 -03:00
9849aac0f1 Don't show .pt models in the list oobabooga 2023-03-09 21:54:50 -03:00
1a3d25f75d

Merge pull request #206 from oobabooga/llama-4bit oobabooga 2023-03-09 21:07:32 -03:00
eb0cb9b6df Update README oobabooga 2023-03-09 20:53:52 -03:00
74102d5ee4 Insert to the path instead of appending oobabooga 2023-03-09 20:51:22 -03:00
2965aa1625 Check if the .pt file exists oobabooga 2023-03-09 20:48:51 -03:00
d41e3c233b

Update README.md oobabooga 2023-03-09 18:02:44 -03:00
fd540b8930 Use new LLaMA implementation (this will break stuff. I am sorry) oobabooga 2023-03-09 17:59:15 -03:00
a24fa781f1 tweaked Whisper parameters EliasVincent 2023-03-09 21:18:46 +01:00
d5efc0659b

Merge branch 'oobabooga:main' into stt-extension Elias Vincent Simon 2023-03-09 21:05:34 +01:00
00359ba054 interactive preview window EliasVincent 2023-03-09 21:03:49 +01:00
7a03d0bda3 cleanup EliasVincent 2023-03-09 20:33:00 +01:00
828a524f9a Add LLaMA 4-bit support oobabooga 2023-03-09 15:50:26 -03:00
33414478bf Update README oobabooga 2023-03-09 11:13:03 -03:00
e7adf5fe4e Add Contrastive Search preset #197 oobabooga 2023-03-09 10:27:11 -03:00
557c773df7

Merge pull request #201 from jtang613/Name_It oobabooga 2023-03-09 09:45:47 -03:00
038e90765b Rename to "Text generation web UI" oobabooga 2023-03-09 09:44:08 -03:00
4c72e43bcf first implementation EliasVincent 2023-03-09 12:46:50 +01:00
4dd14dcab4

Update README.md Chimdumebi Nebolisa 2023-03-09 10:22:09 +01:00
807a41cf87 Lets propose a name besides "Gradio" jtang613 2023-03-08 21:02:25 -05:00
a2b5383398 Merge in audio generation only on text stream finish., postpone audioblock autoplay Xan 2023-03-09 10:48:44 +11:00
59b5f7a4b7 Improve usage of stopping_criteria oobabooga 2023-03-08 12:13:40 -03:00
add9330e5e Bug fixes oobabooga 2023-03-08 11:26:29 -03:00
738be6dd59 Fix merge errors and unlimited wav bug Xan 2023-03-08 22:25:55 +11:00
5648a41a27 Merge branch 'main' of https://github.com/xanthousm/text-generation-webui Xan 2023-03-08 22:08:54 +11:00
ad6b699503 Better TTS with autoplay Xan 2023-03-08 22:02:17 +11:00
33fb6aed74 Minor bug fix oobabooga 2023-03-08 03:08:16 -03:00
ad2970374a Readability improvements oobabooga 2023-03-08 03:00:06 -03:00
72d539dbff Better separate the FlexGen case oobabooga 2023-03-08 02:54:47 -03:00
0e16c0bacb Remove redeclaration of a function oobabooga 2023-03-08 02:50:49 -03:00
ab50f80542 New text streaming method (much faster) oobabooga 2023-03-08 02:46:35 -03:00
c09f416adb Change the Naive preset oobabooga 2023-03-07 23:17:13 -03:00
8e89bc596b Fix encode() for RWKV oobabooga 2023-03-07 23:15:46 -03:00
44e6d82185 Remove unused imports oobabooga 2023-03-07 22:56:15 -03:00
19a34941ed Add proper streaming to RWKV oobabooga 2023-03-07 18:17:56 -03:00
8660227e1b Add top_k to RWKV oobabooga 2023-03-07 17:24:28 -03:00
827ae51f72

Sort the imports oobabooga 2023-03-07 00:23:36 -03:00
b4bfd87319

Update README.md oobabooga 2023-03-06 20:55:01 -03:00
8f4a197c05

Add credits oobabooga 2023-03-06 20:34:36 -03:00
d0e8780555

Update README.md oobabooga 2023-03-06 20:17:59 -03:00
18eaeebbfe Merge branch 'main' of github.com:oobabooga/text-generation-webui oobabooga 2023-03-06 20:16:03 -03:00
18ccfcd7fe

Update README.md oobabooga 2023-03-06 20:15:55 -03:00
153dfeb4dd Add --rwkv-cuda-on parameter, bump rwkv version oobabooga 2023-03-06 20:12:54 -03:00
4143d4aa48

Merge pull request #175 from SagsMug/main oobabooga 2023-03-06 19:53:48 -03:00
8b882c132a

tabs -> spaces oobabooga 2023-03-06 19:52:26 -03:00
eebec65075 Improve readability oobabooga 2023-03-06 19:46:46 -03:00
99f69dfcaa

Merge pull request #169 from MetaIX/patch-1 oobabooga 2023-03-06 19:40:31 -03:00
944fdc03b2 Rename the folder oobabooga 2023-03-06 19:38:36 -03:00
49ae183ac9 Move new extension to a separate file oobabooga 2023-03-06 19:28:53 -03:00
91823e1ed1

Update README.md oobabooga 2023-03-06 16:48:31 -03:00
6904a507c6 Change some parameters oobabooga 2023-03-06 16:29:43 -03:00
20bd645f6a Fix bug in multigpu setups (attempt 3) oobabooga 2023-03-06 15:58:18 -03:00
09a7c36e1b Minor improvement while running custom models oobabooga 2023-03-06 15:36:35 -03:00
24c4c20391 Fix bug in multigpu setups (attempt #2) oobabooga 2023-03-06 15:23:29 -03:00
d88b7836c6 Fix bug in multigpu setups oobabooga 2023-03-06 14:58:30 -03:00
5bed607b77 Increase repetition frequency/penalty for RWKV oobabooga 2023-03-06 14:25:48 -03:00
aa7ce0665e Merge branch 'main' of github.com:oobabooga/text-generation-webui oobabooga 2023-03-06 10:58:41 -03:00
bf56b6c1fb Load settings.json without the need for --settings settings.json oobabooga 2023-03-06 10:57:45 -03:00
2de9f122cd

Update README.md oobabooga 2023-03-06 09:34:49 -03:00
e91f4bc25a Add RWKV tokenizer oobabooga 2023-03-06 08:45:49 -03:00
53ce21ac68 Add api example using websockets Mug 2023-03-06 12:13:50 +01:00
9907bee4a4

Support for Eleven Labs TTS MetaIX 2023-03-05 19:04:22 -06:00
c855b828fe Better handle <USER> oobabooga 2023-03-05 17:01:47 -03:00
145c725c39 Bump RWKV version oobabooga 2023-03-05 16:28:21 -03:00
2af66a4d4c Fix <USER> in pygmalion replies oobabooga 2023-03-05 16:08:50 -03:00
a54b91af77 Improve readability oobabooga 2023-03-05 10:21:15 -03:00
8e706df20e Fix a memory leak when text streaming is on oobabooga 2023-03-05 10:12:43 -03:00