Kubernetes

~/posts/modelplane-fleet-inference 29 min · 5971 words

$ Modelplane - Fleet Inference Across Clusters, Demoed Without a Single GPU

// A hands-on tour of Modelplane, the Crossplane-based control plane for AI inference across a fleet of GPU clusters. Two regions on Kind with fake DRA GPUs, the platform/developer contract written in DRA's own vocabulary, fleet-level drain, and the release trap that costs you two APIs.

~/posts/agent-sandbox 19 min · 3912 words

$ Agent Sandbox - Kubernetes-Native Sandboxes for AI Agent Code Execution

// A hands-on tour of agent-sandbox, the Kubernetes SIG Apps project for isolated, stateful, singleton workloads built for AI agent runtimes. Includes a Go agent with sandboxed tools on Kind, warm pools claiming in 53ms, Flux GitOps, and the gotchas the docs don't mention.

~/posts/llm-d-distributed-inference 21 min · 4271 words

$ llm-d - Kubernetes-Native Distributed LLM Inference at Scale

// A hands-on tour of llm-d, the CNCF Sandbox framework for distributed LLM inference on Kubernetes - inference-aware routing, prefill/decode disaggregation, and KV-cache offload. Includes a GPU-free demo on Kind using the vLLM simulator, wired with Flux GitOps.

~/posts/kubernetes-agent-with-google-adk-go 12 min · 2453 words

$ Building a Read-Only Kubernetes Agent with Google ADK (Go)

// How to build a safe, read-only Kubernetes operations assistant in Go using Google's Agent Development Kit, packaged in a scratch image and deployed via Helm with External Secrets Operator.

~/posts/kserve 20 min · 4183 words

$ KServe - Production ML Serving on Kubernetes, from sklearn to LLMs

// How to use KServe v0.18 in Serverless mode to serve both classical ML models and LLMs on Kubernetes - with scale-to-zero, OpenAI-compatible APIs, Flux GitOps, and a real demo on Apple Silicon.

~/posts/dapr 20 min · 4245 words

$ Dapr - Building a Safe Platform for Citizen Developer Apps on Kubernetes

// How to use Dapr, Flux, Harbor, and a shared Helm chart to safely host apps built by non-technical citizen developers using LLMs on Kubernetes.

~/posts/oauth2-proxy 21 min · 4283 words

$ OAuth2-Proxy - Securing MCP Servers on Kubernetes Before Hackers Find Them First

// MCP servers like DBHub expose databases, filesystems, and code execution over HTTP with zero authentication. Learn how to deploy OAuth2-Proxy on Kubernetes to add SSO, group-based access control, and session management to any MCP server without changing a single line of code.

~/posts/knative 15 min · 3111 words

$ Knative - The Platform Engineer's Guide to Serverless on Kubernetes

// A guide to Knative for SREs and Platform Engineers. Learn how Knative Serving, Eventing, and Functions bring serverless capabilities to any Kubernetes cluster with autoscaling, scale-to-zero, and event-driven architectures.

~/posts/pdb-management-operator 13 min · 2756 words

$ PDB Management Operator - Intelligent Pod Disruption Budget Automation for Kubernetes

// Learn how to automate Pod Disruption Budget management in Kubernetes using the PDB Management Operator. This guide explores the operator's architecture, dual configuration model, enforcement modes, and demonstrates how to use it for enterprise-grade availability management in ODA Canvas environments.

~/posts/kratix 13 min · 2744 words

$ Kratix - Building Self-Service Platform Capabilities for Kubernetes

// Learn how to use Kratix to build self-service platform capabilities for SREs and Platform Engineers. This guide explores Kratix's architecture, the Kratix CLI, pros and cons, and walks through a practical example building an on-demand Datadog stack.

posts tagged #Kubernetes