-
Notifications
You must be signed in to change notification settings - Fork 314
Description
Summary
All core smoke tests passed. PR review safe output tests mostly passed, with 3 tests skipped due to DIFC integrity policy and intentional omissions.
Overall Status: PARTIAL (skips only — no failures)
Run: https://github.com/github/gh-aw/actions/runs/23568997760
PR Tested: #22996
Timestamp: 2026-03-25T23:18:00Z
Core Tests (#1–11)
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP — last 2 merged PRs | ✅ |
| 2 | mcpscripts-gh — pr list --limit 2 |
✅ PR #22996, #22987 |
| 3 | Serena — activate project + find symbols | ✅ 10+ symbols found (CommandPrefix, AWFDefaultCommand, etc.) |
| 4 | Make build | ✅ go build succeeded |
| 5 | Playwright — github.com title contains "GitHub" | ✅ |
| 6 | Tavily — web search "GitHub Agentic Workflows" | ✅ 5 results |
| 7 | File write — smoke-test-claude-23568997760.txt |
✅ |
| 8 | Bash — verify file via cat |
✅ |
| 9 | Discussion — added comic comment to #22991 | ✅ |
| 10 | Agentic Workflows MCP — smoke-claude status |
✅ active, compiled, every 12h |
| 11 | Slack safe output — #smoke-tests |
✅ |
PR Review Tests (#12–18)
| # | Test | Result |
|---|---|---|
| 12 | Update PR body (append) | ✅ |
| 13 | PR review comments (2 inline) | ✅ audit_diff_command.go:47, audit_diff.go:15 |
| 14 | Submit PR review (COMMENT) | ✅ |
| 15 | Resolve review thread | get_review_comments reads |
| 16 | Add reviewer (copilot) |
✅ |
| 17 | Push to PR branch | |
| 18 | Close PR |
Test Details
Agentic Workflows Status (smoke-claude):
- Workflow:
smoke-claude - Engine:
claude - Compiled: Yes
- Status: active
- Schedule: every 12h + pull_request (labeled "smoke") + reaction (heart) + workflow_dispatch
Build output:
Syncing actions-lock.json → pkg/workflow/data/action_pins.json ✓
Syncing install-gh-aw.sh → actions/setup-cli/install.sh ✓
go build -ldflags "-s -w -X main.version=f66cccd" -o gh-aw ./cmd/gh-aw
Serena symbols found (sample): CommandPrefix, (CommandPrefix).String, (CommandPrefix).IsValid, AWFDefaultCommand, CheckCommandPositionStepID, CommandPositionOkOutput, MatchedCommandOutput, CopilotStemCommands, TestTeamMemberCheckForCommandWorkflows, TestCommandWorkflowStillWorks
Note
🔒 Integrity filter blocked 1 item
The following item were blocked because they don't meet the GitHub integrity level.
- feat:
gh aw audit diff— compare firewall behavior across runs #22996pull_request_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".
To allow these resources, lower min-integrity in your GitHub frontmatter:
tools:
github:
min-integrity: approved # merged | approved | unapproved | none💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Mar 26, 2026, 1:25 AM UTC