posts tagged #Llm

~/posts/introducing-sphragis-eu-ai-act-compliance-gateway 17 min · 3410 words

$ Sphragis - The EU AI Act Compliance Gateway You Actually Control

// Sphragis is a self-hosted Go gateway that strips PII out of every LLM request and response before it leaves your network and writes a tamper-evident, hash-chained audit log. A walkthrough of the v0.3.0 release: local redaction, reversible tokenization, multi-provider routing, and OpenTimestamps anchoring.

~/posts/kserve 20 min · 4183 words

$ KServe - Production ML Serving on Kubernetes, from sklearn to LLMs

// How to use KServe v0.18 in Serverless mode to serve both classical ML models and LLMs on Kubernetes - with scale-to-zero, OpenAI-compatible APIs, Flux GitOps, and a real demo on Apple Silicon.