// A hands-on tour of agent-sandbox, the Kubernetes SIG Apps project for isolated, stateful, singleton workloads built for AI agent runtimes. Includes a Go agent with sandboxed tools on Kind, warm pools claiming in 53ms, Flux GitOps, and the gotchas the docs don't mention.
$ neofetch
nick@srekubecraft
Nick Nikolakakis
- role
- Principal SRE, Platform & AI Engineer
- focus
- Kubernetes · CNCF · Platform · AI
- building
- AI agents · LLMOps · MCP
- shell
- zsh
- since
- 2011
// The SRE Diary: Chronicles of Cloud, Kubernetes and AI
// A hands-on tour of llm-d, the CNCF Sandbox framework for distributed LLM inference on Kubernetes - inference-aware routing, prefill/decode disaggregation, and KV-cache offload. Includes a GPU-free demo on Kind using the vLLM simulator, wired with Flux GitOps.
// Choragos runs a team of AI coding agents with a real division of labour: an orchestrator that plans and delegates, workers with their own context, model and credentials, and a delegate/work-done protocol carrying work between them. A walkthrough of v0.11.2 with config recipes for real teams.
// How I built and shipped Pinax, an LLM-buildable dashboard framework for Obsidian, using Claude Code: the guardrails that made agentic development work, the automated review battles, and why machine-checkable success criteria beat vibe coding.
// Sphragis is a self-hosted Go gateway that strips PII out of every LLM request and response before it leaves your network and writes a tamper-evident, hash-chained audit log. A walkthrough of the v0.3.0 release: local redaction, reversible tokenization, multi-provider routing, and OpenTimestamps anchoring.
// How to build a safe, read-only Kubernetes operations assistant in Go using Google's Agent Development Kit, packaged in a scratch image and deployed via Helm with External Secrets Operator.
// How to use KServe v0.18 in Serverless mode to serve both classical ML models and LLMs on Kubernetes - with scale-to-zero, OpenAI-compatible APIs, Flux GitOps, and a real demo on Apple Silicon.
// How to use Dapr, Flux, Harbor, and a shared Helm chart to safely host apps built by non-technical citizen developers using LLMs on Kubernetes.
// MCP servers like DBHub expose databases, filesystems, and code execution over HTTP with zero authentication. Learn how to deploy OAuth2-Proxy on Kubernetes to add SSO, group-based access control, and session management to any MCP server without changing a single line of code.
// A guide to Knative for SREs and Platform Engineers. Learn how Knative Serving, Eventing, and Functions bring serverless capabilities to any Kubernetes cluster with autoscaling, scale-to-zero, and event-driven architectures.