Revision as of 19:53, 4 January 2026 (view source) Allennova (talk \| contribs) m (→‎Maintenance) ← Older edit		Latest revision as of 19:55, 4 January 2026 (view source) Allennova (talk \| contribs) m (→‎Language Models)
====Language Models==== ~~Small~~Language ~~language~~and other models are to be hosted on the two ~~separate~~ GPU's ~~via~~and ~~docker~~are ~~to allow different models running behind the~~than reverse ~~proxy~~proxied. A user on LUG's Sillytavern (or any front end where an API can be called on) can then select what model to prompt. Koboldcpp is currently used to run .GGUF models on mixed CPU and GPU allowing for language models (LLM), embedding models (used for data vectorization), text-to-speech (TTS), speech to text, and image generation under one application.

Docs/Maho: Difference between revisions

Docs/Maho (view source)