Legal-domain work on an edge GPU, 4B Gemma, no cloud APIs
I run Hermes self-hosted on a single edge-class GPU with a 4B Gemma model. I work with legal-domain material and internal systems I cannot ship to third-party APIs. Self-hosting the main loop is non-negotiable.
— @arkka, 2026, via GitHub.