posts tagged #Flux

~/posts/kserve 20 min · 4183 words

$ KServe - Production ML Serving on Kubernetes, from sklearn to LLMs

// How to use KServe v0.18 in Serverless mode to serve both classical ML models and LLMs on Kubernetes - with scale-to-zero, OpenAI-compatible APIs, Flux GitOps, and a real demo on Apple Silicon.

~/posts/dapr 20 min · 4245 words

$ Dapr - Building a Safe Platform for Citizen Developer Apps on Kubernetes

// How to use Dapr, Flux, Harbor, and a shared Helm chart to safely host apps built by non-technical citizen developers using LLMs on Kubernetes.