GuidePlatform engineering
Disruption budgets and the capacity left behind
Plan an inference-service node drain with a scoped disruption budget, replacement-capacity checks and a practical maintenance worksheet.
Guides, news and explanations about AI and reliable systems.
Plan an inference-service node drain with a scoped disruption budget, replacement-capacity checks and a practical maintenance worksheet.
Kubernetes attributes connect agent calls to pods, workloads and paging routes. A processor migration can break those connections while telemetry still flows.
Host-memory throttling can keep an inference process alive while its requests slow down. Effective kubelet settings and request deadlines explain the tradeoff.
Images package processes and Kubernetes reconciles their deployment. Probes, resource settings and completed jobs reveal different stages of the service.