It's a software monitoring best practice to alert on symptoms, not on causes. "Customer Order Rate dropped to 0" is a great alert: it alerts directly on a bad outcome. For machine learning stacks, this means we should focus monitoring on the output of our models. Data monitoring is also helpful, but should come later in your maturity cycle. In this talk, I will provide practical strategies for prioritizing your monitoring efforts.