Alerting review

[devopsmatt]

We want to make alerting less burdensome.
This work item is to figure out and document ways to:

• filter out the noise
• add context to the alerts to make them easier to act on
• figure out a way to better categorize them, so they can be routed more accurately
• figure out if any resolutions can be automated
• [ ]

DoD: Documentation around ways to accomplish the tasks above, so that we can create new tickets and schedule the followup deliverables.

[etanb]

FYI @victor-chaparro @chris-kuryak Experience should be aware / a part of any relevant discussions in regards to this ticket.