14 commits

Author	SHA1	Message	Date
oobabooga	b227e65d86	Add grammar to llama.cpp loader (closes #4019)	2023-09-24 07:10:45 -07:00
saltacc	f01b9aa71f	Add customizable ban tokens (#3899)	2023-09-15 18:27:27 -03:00
oobabooga	cec8db52e5	Add max_tokens_second param (#3533)	2023-08-29 17:44:31 -03:00
oobabooga	e8c0c4990d	Unescape HTML in the chat API examples	2023-08-28 19:42:03 -07:00
oobabooga	a1a9ec895d	Unify the 3 interface modes (#3554)	2023-08-13 01:12:15 -03:00
jllllll	2cf64474f2	Use chat_instruct_command in API (#3482)	2023-08-06 23:46:25 -03:00
oobabooga	0af10ab49b	Add Classifier Free Guidance (CFG) for Transformers/ExLlama (#3325)	2023-08-06 17:22:48 -03:00
rafa-9	d578baeb2c	Use character settings from API properties if present (#3428)	2023-08-03 15:56:40 -03:00
oobabooga	e931844fe2	Add auto_max_new_tokens parameter (#3419)	2023-08-02 14:52:20 -03:00
atriantafy	d9fabdde40	Add context_instruct to API. Load default model instruction template … (#2688)	2023-07-12 00:01:03 -03:00
oobabooga	3443219cbc	Add repetition penalty range parameter to transformers (#2916)	2023-06-29 13:40:13 -03:00
oobabooga	c52290de50	ExLlama with long context (#2875)	2023-06-25 22:49:26 -03:00
oobabooga	474dc7355a	Allow API requests to use parameter presets	2023-06-14 11:32:20 -03:00
oobabooga	632571a009	Update README	2023-06-05 15:16:06 -03:00

Renamed from api-example-chat-stream.py (Browse further)