LLMOps
Model serving, routing, and versioning. vLLM, llama.cpp, SGLang — with caching, quantization, and cost controls that survive real traffic.
We design, build, and operate LLMOps and AI platform engineering — inference, RAG, agent runtimes, and evaluation — so your team ships AI products instead of debugging GPU drivers.
Model serving, routing, and versioning. vLLM, llama.cpp, SGLang — with caching, quantization, and cost controls that survive real traffic.
The internal platform your AI teams build on: GPU scheduling, multi-tenant namespaces, quotas, and self-serve deploys.
Ingestion, chunking, embeddings, vector search, reranking. Grounded answers with citations — evaluated, not vibes.
Tool-calling agents in production: sandboxed execution, state, memory, retries, and human-in-the-loop gates.
Golden sets, regression suites, token and latency tracing, drift alerts. Know whether your model change helped or hurt.
Kubernetes GPU clusters on AWS, GCP, or bare metal. IaC with Terraform and Pulumi — reproducible and audited.
Founder · AI Platform Engineer
15+ years building high-load infrastructure — mobile, fintech, telco, AI. Runs a self-hosted LLM stack with production agents on it, so he knows what LLMOps costs in GPUs and headcount.
Growing the team — get in touch if you run AI workloads in production and want to work async from anywhere in EU.
DevOps.AI s.r.o. is a Bratislava-based AI platform engineering company. We build LLMOps platforms and production AI systems for companies across Europe — on AWS, GCP, and bare metal. We run our own agents (OpenClaw & Hermes) on a self-hosted LLM stack, so we know what "production AI" actually takes.