posts tagged #Istio

~/posts/kserve 20 min · 4183 words

$ KServe - Production ML Serving on Kubernetes, from sklearn to LLMs

// How to use KServe v0.18 in Serverless mode to serve both classical ML models and LLMs on Kubernetes - with scale-to-zero, OpenAI-compatible APIs, Flux GitOps, and a real demo on Apple Silicon.

~/posts/istio-ambient-mesh 4 min · 785 words

$ Simplifying Kubernetes Service Mesh - A Deep Dive into Istio Ambient Mesh

// A comprehensive guide to Istio Ambient Mesh, exploring its sidecar-less architecture, performance benefits, and practical implementation steps. Learn how zTunnel and Waypoint Proxy revolutionize service mesh deployment while reducing resource overhead.