feat: add /ci-report slash command for oncall CI monitoring#3170
feat: add /ci-report slash command for oncall CI monitoring#3170Stringy wants to merge 1 commit into
Conversation
Adds a Claude Code slash command that generates CI oncall handoff reports by analyzing GitHub Actions workflow runs on master and release branches. Features: - Natural language time ranges (e.g. /ci-report last 3 days) - Branch health summary with pass rates and links - Root cause analysis that digs past symptoms (e.g. tar failures) to find actual test failures and infrastructure issues - Flaky test detection with same-root-cause requirement - Trends section comparing against previous reports - Reports saved to docs/oncall/ for team handoff Invoke with: /ci-report [time range] Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Stringy
force-pushed
the
giles/claude-ci-report
branch
from
c56c992 to
087d6e0
Compare
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## master #3170 +/- ##
=======================================
Coverage 27.38% 27.38%
=======================================
Files 95 95
Lines 5427 5427
Branches 2548 2548
=======================================
Hits 1486 1486
Misses 3214 3214
Partials 727 727
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. |
|
/retest collector-on-push |
| Look for existing report files in `docs/oncall/`: | ||
| ```bash | ||
| ls -1 docs/oncall/*-ci-report*.md 2>/dev/null | sort -r | head -5 | ||
| ``` |
There was a problem hiding this comment.
Does this imply we are going to be commiting oncall reports to the repo? I would rather we don't do that. We can probably setup some bucket somewhere in the cloud and have Claudio pull from there.
There was a problem hiding this comment.
Unless the idea is to have a full CI job that will pull and backup the reports to the cloud. Either way, I think we should add docs/oncall/ to our .gitignore.
|
|
||
| 1. Get the failed jobs: | ||
| ```bash | ||
| gh run view RUN_ID --repo REPO --json jobs |
There was a problem hiding this comment.
This is maybe a more personal note, we need a way to isolate Claudio during the execution of this skill, I have it running locally and it is using my credentials to run gh commands, I had to allow it to run gh run on its own because it wouldn't allow me to restrict it to gh run view and it is making me pretty nervous.
4 participants
Adds a Claude Code slash command that generates CI oncall handoff reports by analyzing GitHub Actions workflow runs on master and release branches.
Features:
Invoke with: /ci-report [time range]