Skip to content

Commit

Permalink
Add dashboard monitoring to perf sheriff duties
Browse files Browse the repository at this point in the history
Change-Id: I56eec3ca11785a6d796d28ca07220f4aa6ff1212
Reviewed-on: https://chromium-review.googlesource.com/c/chromium/src/+/2486542
Auto-Submit: Ryan Heise <heiserya@google.com>
Commit-Queue: Wenbin Zhang <wenbinzhang@google.com>
Reviewed-by: John Chen <johnchen@chromium.org>
Reviewed-by: Wenbin Zhang <wenbinzhang@google.com>
Cr-Commit-Position: refs/heads/master@{#818792}
  • Loading branch information
heiserya-g authored and Commit Bot committed Oct 20, 2020
1 parent e31db27 commit f6a5341
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion docs/speed/bot_health_sheriffing/main.md
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,9 @@ roll](https://autoroll.skia.org/r/catapult-autoroll), which should
automatically TBR the sheriff. If the catapult roll fails, the sheriff should
investigate and revert suspect changelists.

The sheriff should *not* feel like responsible for investigating hard problems. The volume of incoming alerts makes this infeasible. Instead, they should delegate deep investigations to the right owners. As a rule of thumb, a trained sheriff should expect to spend 10-20 minutes per alert and should never be spending more than an hour per alert.
Near the end of their shift, sheriffs should also inspect[this dashboard](https://dashboards.corp.google.com/_e3cbeb60_d250_4e67_8795_56cd9af8a303) for the time covered during their shift, and do a first-pass analysis of any anomalies (e.g. jobs taking 6 hours when they normally take 1.5).

The sheriff should *not* feel responsible for investigating hard problems. The volume of incoming alerts makes this infeasible. Instead, they should delegate deep investigations to the right owners. As a rule of thumb, a trained sheriff should expect to spend 10-20 minutes per alert and should never be spending more than an hour per alert.

## Workflow

Expand Down

0 comments on commit f6a5341

Please sign in to comment.