LLM Costs and Observability with agentgateway on Kubernetes (Part 2)
Part 2: scrape agentgateway with Prometheus, build a Grafana dashboard of token cost and per-tool usage, see blocked tool calls, and alert on spend.
The Blog
Kubesimplify Blog
Deep dives on Kubernetes, AI infrastructure, GitOps, and the cloud-native stack, written by practitioners.
Latest
kubernetesai-agentsJun 30, 2026
LLM Costs and Observability with agentgateway on Kubernetes (Part 2)
Part 2: scrape agentgateway with Prometheus, build a Grafana dashboard of token cost and per-tool usage, see blocked tool calls, and alert on spend.
Shubham Katara · 12 min
kubernetesai-agentsJun 29, 2026
Controlling MCP Tools with agentgateway on Kubernetes (Part 1)
Run AI agents behind agentgateway on Kubernetes: route their LLM and MCP tool calls through one proxy, keep secrets out of the agent, and block tools by policy.
Shubham Katara · 22 min
nvidiadgxsparkJun 10, 2026
Day 4: Quantization Demystified. BF16, FP8, NVFP4, MXFP4, INT4, GGUF, and Why It All Matters
A practical, beginner-friendly guide to BF16, FP8, NVFP4, MXFP4, INT4, and GGUF Q4_K_M on NVIDIA DGX Spark. Bytes per parameter, quality vs size, and which format to pick when.
Saiyam Pathak · 28 minSeries
All series →7 parts
7 Days of Docker
A week-long journey from your first docker run to production-ready containers.
by Saloni Narang4 parts
7 Days of DGX Spark
Hands-on with NVIDIA DGX Spark, from unboxing to running 120B-parameter models.
by Saiyam Pathak2 parts
agentgateway on Kubernetes
Put your AI agents behind a gateway: lock down their tools, then see what they cost.
by Shubham KataraTopic hubs
Kubernetes
Deep dives on the world's most-deployed orchestrator.
Docker & Containers
Container internals, image building, and developer workflows.
AI & ML on Cloud Native
Running AI/ML workloads on Kubernetes and modern infrastructure.
DevOps & Platform
CI/CD, GitOps, IaC, and the platform-engineering playbook.
Cloud Native Security
Hardening containers, Kubernetes, and the supply chain.
Linux Fundamentals
The OS underneath every container, cluster, and cloud.
Browse by tag
Newsletter
Kubesimplify Diaries
Subscribe to get our latest Kubernetes, AI infra, and cloud-native articles delivered to your inbox.
Subscribe on SubstackPowered by Substack · Unsubscribe anytime
All posts
187 posts · page 1 of 13
Controlling MCP Tools with agentgateway on Kubernetes (Part 1)
Run AI agents behind agentgateway on Kubernetes: route their LLM and MCP tool calls through one proxy, keep secrets out of the agent, and block tools by policy.
Day 4: Quantization Demystified. BF16, FP8, NVFP4, MXFP4, INT4, GGUF, and Why It All Matters
A practical, beginner-friendly guide to BF16, FP8, NVFP4, MXFP4, INT4, and GGUF Q4_K_M on NVIDIA DGX Spark. Bytes per parameter, quality vs size, and which format to pick when.
Day 3: The DGX Spark Unpacked. GB10, Unified Memory, sm_121, and the One Reason This Hardware Exists
A practical teardown of NVIDIA DGX Spark's GB10 Grace Blackwell Superchip, unified memory, sm_121, NVFP4 tensor cores, memory reporting, and decode limits.
Wandler: Local OpenAI-Compatible Inference With Transformers.js and WebGPU
A practical Wandler deep dive with a local M1 Max WebGPU demo, real latency numbers, architecture diagrams, and getting-started commands.
mlxcel: A Rust-Native Inference Engine for Apple Silicon, Tested on My M1 Max
Day-one deep dive into mlxcel v0.1.0, a Rust-native MLX inference engine. Real M1 Max benchmarks vs mlx-lm and Ollama on Llama 3.2 3B and Qwen 2.5 7B, with architecture diagrams and an honest take on TurboQuant.
Day 2: Anatomy of an LLM Inference Request. From Prompt to Answer, Step by Step
A beginner-friendly walkthrough of tokenization, prefill, KV cache, decode, batching, TTFT, and why memory bandwidth shapes local LLM performance on NVIDIA DGX Spark.
How kube-proxy Actually Works: iptables, IPVS, and nftables Inside Out
How kube-proxy turns Kubernetes Services into kernel rules. iptables, IPVS, nftables packet paths and which to pick in 2026. Verified against k/k 1.36 source.
Day 1: The Local LLM Revolution. Why Your Desk Just Became the New Datacenter
Why local LLMs are becoming practical in 2026, what changed across open weights, hardware, and inference software, and why DGX Spark makes the desk feel like a small AI lab.
How Kubernetes EndpointSlices Actually Work (and Why Endpoints Had to Die)
A Service has no pod IPs in it. We covered that in the last post. So somewhere, something is keeping a list of every pod IP that matches the Service's…
NVCF Is Now Open Source: Inside NVIDIA's GPU Function Platform
NVIDIA just open-sourced the full NVCF platform under Apache 2.0. Not a thin SDK, not a client library. The actual control plane, invocation plane,…
How a Kubernetes Service Actually Works (and All 5 Types You Need)
A pod gets created. It gets an IP. Then it dies. A new pod replaces it. New IP. Now imagine you have ten pods of the same app, and they restart all the…
Day 7: Ship It - and What Comes Next
Your container runs as root and has 18 CVEs. A Docker Captain's guide to hardening, Scout policies, DHI, Sandboxes, and what comes after Docker.
Day 6: Run an LLM on Your Laptop - With Docker
"Pull AI models from Docker Hub, run them locally with GPU acceleration, and build an AI-powered app
A Kubeconfig for GKE That Doesn't Need gcloud
When you run gcloud container clusters get-credentials , the kubeconfig it writes looks innocent — until you hand it to a teammate and they hit: …or the…