ETHUXModel, cluster, application.
When the API is not enough: we build it on your hardware, or ours.
Services
Three layers. No vendor maze.
On-prem AI
LLMs running on your GPUs.
- vLLM, SGLang and Ollama
- RAG with local vector stores
- Fine-tuning on your hardware
- OpenAI-compatible routing
- GPU monitoring and capacity planning
Private cloud and hybrid infra
The cluster underneath the AI.
- Talos Linux and Kubernetes
- FluxCD GitOps
- Proxmox and GPU passthrough
- Grafana, Prometheus, Loki
- Self-hosted GitLab and CI runners
Custom apps
Software for what off-the-shelf cannot do.
- FastAPI services and internal tools
- Next.js dashboards and admin panels
- n8n workflow automation
- Self-hosted SaaS replacements
- Integrations between your tools
The stack
The actual tools.
The exact tools matter.
InferencevLLM, SGLang, Ollama, LMCache
ModelsMistral, MiniMax, Qwen
OrchestrationTalos, Kubernetes, FluxCD, Helm
VirtualisationProxmox, GPU passthrough, cloud-init
AutomationOpenTofu, Ansible, n8n
CI/CDGitLab, GitLab CI
ObservabilityGrafana, Prometheus, Loki, ClickHouse
App layerFastAPI, Next.js, Postgres, Redis
PrivacyErebus, Headscale