posts tagged #Gitops

~/posts/llm-d-distributed-inference 21 min · 4271 words

// A hands-on tour of llm-d, the CNCF Sandbox framework for distributed LLM inference on Kubernetes - inference-aware routing, prefill/decode disaggregation, and KV-cache offload. Includes a GPU-free demo on Kind using the vLLM simulator, wired with Flux GitOps.

~/posts/idp 16 min · 3397 words

// Learn how to build a powerful Internal Developer Portal (IDP) using Azure Kubernetes Service (AKS), Crossplane, Backstage, and Argo CD. Empower developers with self-service while maintaining governance, automation, and GitOps best practices. A complete guide for platform engineers and SREs building cloud-native platforms.