Clone
1
What is considered a SEV?
Zain Rizvi edited this page 2023-05-10 14:32:30 -05:00
This file contains ambiguous Unicode characters

This file contains Unicode characters that might be confused with other characters. If you think that this is intentional, you can safely ignore this warning. Use the Escape button to reveal them.

File a SEV

Why do we file SEVs?

  1. Alert devs that something is currently wrong with the CI and they may see failures that theyre not responsible for
  2. Track developer facing issues so that we can appropriately prioritize fixing (without SEVs these can get forgotten)

Whats considered a SEV?

When there is a widespread CI breakage that is not resolvable by doing a revert (e.g. its an issue with the underlying CI infra), you should file a SEV using the CI SEV issue template.

Rules of thumb

  • If its bad enough that people multiple people will ask us about it on any of our contributor communication channels
  • If it affects more than ~10% of users and might last over 30 minutes, its a SEV
  • If were expecting people to force push to work around it, its a SEV

If the above still leaves it ambiguous, we default to considering it a SEV.

If the sev is severe enough (generally defined as "the CI is likely to miss legitimate failures", the template includes instructions on how to make it merge blocking to prevent contributors from accidentally merging broken code.

During a SEV

HUD and the Dr. CI comment at the top of the PR will both explain that there's a SEV ongoing and link to the active sev.

If the SEV is marked as merge blocking, @pytorchbot will default to preventing PRs from being merged