Platform engineering5 min read
Kubernetes Memory QoS: what AI inference teams should test
Memory QoS reaches beta in Kubernetes 1.37. For AI inference teams, the rollout question is how host-memory policy affects serving latency and neighboring workers.
Background reading: Platform engineering