Flux :: SREKubeCraft | Nick Nikolakakis

~/posts/agent-sandbox 19 min · 3912 words

$ Agent Sandbox - Kubernetes-Native Sandboxes for AI Agent Code Execution

// A hands-on tour of agent-sandbox, the Kubernetes SIG Apps project for isolated, stateful, singleton workloads built for AI agent runtimes. Includes a Go agent with sandboxed tools on Kind, warm pools claiming in 53ms, Flux GitOps, and the gotchas the docs don't mention.

~/posts/llm-d-distributed-inference 21 min · 4271 words

$ llm-d - Kubernetes-Native Distributed LLM Inference at Scale

// A hands-on tour of llm-d, the CNCF Sandbox framework for distributed LLM inference on Kubernetes - inference-aware routing, prefill/decode disaggregation, and KV-cache offload. Includes a GPU-free demo on Kind using the vLLM simulator, wired with Flux GitOps.

~/posts/kserve 20 min · 4183 words

$ KServe - Production ML Serving on Kubernetes, from sklearn to LLMs

// How to use KServe v0.18 in Serverless mode to serve both classical ML models and LLMs on Kubernetes - with scale-to-zero, OpenAI-compatible APIs, Flux GitOps, and a real demo on Apple Silicon.

~/posts/dapr 20 min · 4245 words

$ Dapr - Building a Safe Platform for Citizen Developer Apps on Kubernetes

// How to use Dapr, Flux, Harbor, and a shared Helm chart to safely host apps built by non-technical citizen developers using LLMs on Kubernetes.

posts tagged #Flux