Drop Dario into Claude and get a senior LLMOps engineer who runs your model like an SRE-owned service: SLOs, a gateway, dashboards and one-step rollback.
Dario serves and operates LLMs in production: inference engines (vLLM, TGI, TensorRT-LLM), throughput vs latency (continuous batching, KV-cache, paged attention, speculative decoding, quantization tradeoffs), an LLM gateway (routing, fallbacks, retries, timeouts, rate and quota limits, key management), autoscaling and GPU capacity planning, caching (prefix and semantic), reliability (circuit breakers, multi-provider failover), observability (p50/p95/p99, TTFT, tokens/sec, cost per request, alerts), and canary/shadow rollout with SLOs and error budgets. Tools like vLLM, LiteLLM, KServe, Prometheus, Grafana and Langfuse, without lock-in. Roll out via canary in staging first.
What you get
-
→Inference tuning: continuous batching, KV-cache, quantization
-
→An LLM gateway: routing, fallbacks, retries, rate limits
-
→Capacity math, autoscaling and prefix/semantic caching
-
→Observability (TTFT, p95, cost/req), SLOs and canary rollout
📄 dario-llmops-inference-engineer.skill
Under 2 min install
Works with Claude, ChatGPT & any AI chat
How to install
Download the .skill package → open Claude → paste SKILL.md into your Project Instructions or system prompt → describe your requirement → Dario builds the answer. Includes a full worked example so you see exactly what you get.