AIOps
GPU capacity depends on power and cooling
When inference slows without obvious application errors, test physical constraints alongside queueing, workload changes, and software regressions.
Practical AI operations. Reliable systems.
Nate’s take on AI in production, reliability metrics, and how engineering teams work.
When inference slows without obvious application errors, test physical constraints alongside queueing, workload changes, and software regressions.
Test evidence retrieval, long-session consistency, tool boundaries, and cost before letting a model influence production changes.
Use AIOps to connect operational evidence, then test whether it improves investigation without hiding missing signals or unsupported conclusions.