vault / mlops / kubernetes.md

Kubernetes

ML platform 56 words 2 outgoing 1 backlinks

Kubernetes stores desired state while controllers keep trying to make the running system match it. A Deployment manages replicas, a Service gives traffic a stable destination, and Helm packages configuration. That mental model is more useful than memorising object names without knowing which controller or traffic path they belong to.

Read the full example: related post.

LINKS IN THIS NOTE

[[ Model serving ]] A trained model is not yet a service. A shared serving path handles the repeated work around it: authentication, tracing, deployment conventions and orchestration. Keep the supported path narrow and explain failures clearly. The post distinguishes the interface I built... [[ Observability ]] For feedback investigation, record enough of the request to reconstruct what happened: the question, retrieval, response and relevant configuration. A trace helps connect those steps. Dashboards can show a pattern, but a concrete replay is often what tells us which...