text-generation-webui

mmarch/text-generation-webui

Fork 0

Commit graph

90bb2caffd

Update README.md oobabooga 2023-02-03 19:45:11 -03:00
9215e281ba Add --threads option to the download script oobabooga 2023-02-03 18:57:12 -03:00
03f084f311 Add safetensors support oobabooga 2023-02-03 18:36:32 -03:00
93b0d1b1b8

Update README.md oobabooga 2023-02-03 10:14:52 -03:00
44e8c671f9 Fix API documentation formatting in chat mode oobabooga 2023-02-03 10:00:05 -03:00
03ebfba0fb Bump bitsandbytes version oobabooga 2023-02-03 09:29:31 -03:00
6212b41930 Update README oobabooga 2023-02-03 09:13:14 -03:00
a28f0d8bd7 Show it/s in the same units with or without streaming oobabooga 2023-02-03 09:11:11 -03:00
4e4cd67223 Save chat history with name/date in filename oobabooga 2023-02-03 09:02:35 -03:00
3af3ffeb90 Make --help output more readable oobabooga 2023-02-02 23:36:28 -03:00
638495b633 Simplify generate() function oobabooga 2023-02-02 13:47:08 -03:00
3f05cf5ddd Simplify encode() function oobabooga 2023-02-02 13:31:32 -03:00
afc2b0f4c8 Remove .gitignore oobabooga 2023-02-02 12:42:49 -03:00
224be31a74 Use main bs4 package oobabooga 2023-02-02 12:20:58 -03:00
cecaebc291 Add bs4 requirement (fixes #47) oobabooga 2023-02-02 12:18:32 -03:00
0c2eb444e6 Merge branch 'main' of github.com:oobabooga/text-generation-webui oobabooga 2023-02-02 12:17:02 -03:00
2583bc5840 Simplify deepspeed implementation (#40) oobabooga 2023-02-02 12:15:44 -03:00
7f4315b120

Mention 8bit fix for Windows users oobabooga 2023-02-02 11:00:57 -03:00
d6b2d68527 Remove redundant requirements oobabooga 2023-02-02 10:40:09 -03:00
f38c9bf428 Fix deepspeed (oops) oobabooga 2023-02-02 10:39:37 -03:00
90f1067598 Move deepspeed parameters to another file oobabooga 2023-02-02 10:25:09 -03:00
1a658b41aa

Merge pull request #43 from 81300/ds oobabooga 2023-02-02 10:03:19 -03:00
39461bd796

Delete .gitignore oobabooga 2023-02-02 10:01:56 -03:00
248ec4fa21

Merge branch 'oobabooga:main' into ds 81300 2023-02-01 20:50:51 +02:00
a6f4760772

Add arg for bfloat16 81300 2023-02-01 20:22:07 +02:00
c515282f5c

no_split_module_classes not needed 81300 2023-02-01 19:47:26 +02:00
0a0d289537

Fix issue with generating on multiple GPUs 81300 2023-02-01 19:02:07 +02:00
a97afa6965

Add DeepSpeed ZeRO-3 integration 81300 2023-02-01 14:57:27 +02:00
6b13816c47 Change default --disk behavior oobabooga 2023-02-01 10:43:28 -03:00
119be56390 Add back low_cpu_mem_usage=True oobabooga 2023-02-01 10:01:44 -03:00
d4a0b377ab Allow standalone --cpu-memory oobabooga 2023-01-31 21:23:16 -03:00
efb0ab502e New preset oobabooga 2023-01-31 21:03:25 -03:00
8ef89df746 Try to leave at least 1GiB free to prevent oom errors oobabooga 2023-01-31 20:47:05 -03:00
bb77f20a6c Don't use low_cpu_mem_usage and device_map together oobabooga 2023-01-31 13:24:05 -03:00
824329749d

Merge pull request #38 from Silver267/patch-2 oobabooga 2023-01-31 08:14:50 -03:00
001ecf95b2

Update server.py oobabooga 2023-01-31 08:14:16 -03:00
a85bb5e9a2

Fix an error Silver267 2023-01-31 01:34:10 -05:00
5b0bbfa6e8 Clean up oobabooga 2023-01-30 14:17:12 -03:00
7aa3d6583e

Update README.md oobabooga 2023-01-30 09:45:31 -03:00
239f96a9c5

Add extensions guide oobabooga 2023-01-30 09:44:57 -03:00
dfbca86533 Add **bold** support in chat mode oobabooga 2023-01-30 08:36:58 -03:00
2dadf42cb5 Print the tokenized example dialogue in a prettier way oobabooga 2023-01-30 08:29:49 -03:00
161cae001b I needed this oobabooga 2023-01-29 23:20:22 -03:00
3ebca480f6 Minor fix oobabooga 2023-01-29 23:05:17 -03:00
00707a0b3b Add "Impersonate" button oobabooga 2023-01-29 22:56:23 -03:00
ad148571f4 Add fixed Google Translation extension oobabooga 2023-01-29 14:55:24 -03:00
b19415849c Merge branch 'main' of github.com:oobabooga/text-generation-webui oobabooga 2023-01-29 14:41:41 -03:00
584a7dd50d Remove defective extension oobabooga 2023-01-29 14:40:14 -03:00
f92996b3c8

Update README.md oobabooga 2023-01-29 14:37:05 -03:00
de72e83508 Reorganize things oobabooga 2023-01-29 14:27:22 -03:00
6fbfee9e6d Remove some bloat oobabooga 2023-01-29 12:05:18 -03:00
9c9bd1074f Add option to replace the bot's last reply oobabooga 2023-01-29 12:02:44 -03:00
e5ff4ddfc8 Add bot prefix modifier option in extensions oobabooga 2023-01-29 10:11:59 -03:00
c1c129196e Merge branch 'main' of github.com:oobabooga/text-generation-webui oobabooga 2023-01-29 09:48:44 -03:00
b6d01bb704 Enable extensions in all modes, not just chat oobabooga 2023-01-29 09:48:18 -03:00
ba33e6f1d3

Delete .github/ISSUE_TEMPLATE directory oobabooga 2023-01-29 09:37:05 -03:00
af09b0ed9a

Update issue templates oobabooga 2023-01-29 09:36:11 -03:00
9e4db10cd0

Update README.md oobabooga 2023-01-29 03:13:22 -03:00
1a139664f5 Grammar oobabooga 2023-01-29 02:54:36 -03:00
2d134031ca Apply extensions to character greeting oobabooga 2023-01-29 00:04:11 -03:00
c9447da898 Rename extension oobabooga 2023-01-28 23:47:15 -03:00
1a8d815de4 Make src and dst languages explicit oobabooga 2023-01-28 23:29:17 -03:00
7ff68ef252 Add Google Translate extension oobabooga 2023-01-28 23:26:07 -03:00
e349b52256 Read extensions parameters from settings file oobabooga 2023-01-28 23:21:40 -03:00
2239be2351 Support for number/bool extension parameters oobabooga 2023-01-28 23:08:28 -03:00
6da94e358c Add support for extensions parameters oobabooga 2023-01-28 23:00:51 -03:00
e779fd795f Save TavernAI characters with TavernAI- prefix oobabooga 2023-01-28 21:01:56 -03:00
833a1138fa Explain the dialogue tokenization output oobabooga 2023-01-28 20:41:02 -03:00
89c862b179 Update README oobabooga 2023-01-28 20:37:43 -03:00
545b7395b2 Prevent huge --help outputs oobabooga 2023-01-28 20:36:51 -03:00
f4c455ce29

Merge pull request #30 from 10sa/patch-1 oobabooga 2023-01-28 20:35:20 -03:00
7b283a4a3d

Update server.py oobabooga 2023-01-28 20:35:05 -03:00
f4674d34a9 Reorganize chat UI elements oobabooga 2023-01-28 20:28:08 -03:00
3687962e6c Add support for TavernAI character cards (closes #31) oobabooga 2023-01-28 20:18:23 -03:00
f71531186b Upload profile pictures from the web UI oobabooga 2023-01-28 19:16:37 -03:00
3742d3b18a

Add listening port options for listening mode. Tensa 2023-01-28 03:38:34 +09:00
69ffef4391 History loading minor bug fix oobabooga 2023-01-27 12:01:11 -03:00
8b8236c6ff Fix Regenerate button bug oobabooga 2023-01-27 11:14:19 -03:00
1d1f931757 Load extensions at startup oobabooga 2023-01-27 10:53:05 -03:00
70e034589f Update the export/load chat history functions oobabooga 2023-01-27 02:16:05 -03:00
6b5dcd46c5 Add support for extensions oobabooga 2023-01-27 00:40:39 -03:00
414fa9d161

Revert transformers version (gpt-j and opt are broken) oobabooga 2023-01-26 23:01:13 -03:00
8f134ac5db

Merge pull request #27 from Silver267/patch-1 oobabooga 2023-01-26 19:00:32 -03:00
e69990e37b Change order of upload and download tabs in chat mode oobabooga 2023-01-26 16:57:12 -03:00
d49710878e

Update README.md oobabooga 2023-01-26 16:17:15 -03:00
531db98da0 Merge branch 'main' of github.com:oobabooga/text-generation-webui oobabooga 2023-01-26 13:45:48 -03:00
ac6065d5ed Fix character loading bug oobabooga 2023-01-26 13:45:19 -03:00
ff180f3e60

Update installation instructions (for #15) oobabooga 2023-01-26 12:32:21 -03:00
ff290c6f66

Merge branch 'oobabooga:main' into patch-1 Silver267 2023-01-26 01:44:18 -05:00
3d9a499a02 Merge branch 'main' of github.com:oobabooga/text-generation-webui oobabooga 2023-01-26 02:18:24 -03:00
61611197e0 Add --verbose option (oops) oobabooga 2023-01-26 02:12:53 -03:00
1462277923 Add --debug option oobabooga 2023-01-26 02:12:53 -03:00
ad191e295b

bump transformers Silver267 2023-01-25 23:22:20 -05:00
abc920752f Stop at eos_token while streaming text (for #26) oobabooga 2023-01-25 22:27:04 -03:00
64f278d248 Update README oobabooga 2023-01-25 19:43:30 -03:00
c4f51b64e6 Merge branch 'main' of github.com:oobabooga/text-generation-webui oobabooga 2023-01-25 19:40:54 -03:00
b77933d327 File names must be img_me.jpg and img_bot.jpg oobabooga 2023-01-25 19:39:36 -03:00
defe343c1d File names must be img_you.jpg and img_bot.jpg oobabooga 2023-01-25 19:39:36 -03:00
fc73188ec7 Allow specifying your own profile picture in chat mode oobabooga 2023-01-25 19:37:44 -03:00
3fa14befc5 Bump the gradio version, add back the queue oobabooga 2023-01-25 16:10:35 -03:00