Docs/Maho

Maho holds a number of Graphical Processing Units (GPUs) and services either transcoding video or running Large Language Models (LLM's).

Hardware

Maho is a standalone Dell R730 server (2.5" drive bay variant)

Network daughter card has been swapped out for a Dell 165T0 Broadcom 57800S, a 2 port ethernet and 2 port SFP+ card.

Operating System

Mirrors runs Debian 13.

(Additional storage information)

Maintenance

Media is added to /salieri/jellyfin/import

(Detail about ism's and how to administrate/add media)

Services

Services are based on this machine but may call remote machines (and therefore remote GPU's) for remote compute via rffmpeg (transcoding) or a OpenAI reverse proxy (LLM)

Jellyfin

Jellyfin is installed to its default location (location) and is reverse proxied via nginx. Media is located in /salieri/jellyfin/media with subfolders spanning into media types. Media inside this ../media folder is managed/renamed by the *arr suite. /salieri/jellyfin/imports is a holding directory for unsorted media. *arr has access to these folders as /download/(subfolder) and can be sorted futher/moved into ../media.

(add more jellyfin service detail)

*arr

The *arr suite is running inside docker containers on maho as a single host. The compose file can be found at /opt/podman/compose/arr/docker-compose.yaml and holds the *arr suite as a single service, allowing for one-liner updates/replaces.

(Detail about *arr setup and how to change settings)

Language Models

Small language models are to be hosted on the two separate GPU's via docker to allow different models running behind the reverse proxy. A user on LUG's Sillytavern (or any front end where an API can be called on) can then select what model to prompt.

(Allen thing)