Payload
{
"action": "edited",
"changes": {
"body": {
"from": "\n<!--\n 0 failure: \n 3 warning: PR description is..., No Linear issue I..., This PR touches b...\n \n 2 markdown notices\n DangerID: danger-id-Danger;\n-->\n\n\n<table>\n <thead>\n <tr>\n <th width=\"50\"></th>\n <th width=\"100%\" data-danger-table=\"true\">Warnings</th>\n </tr>\n </thead>\n <tbody><tr>\n <td>:warning:</td>\n <td>\n\n PR description is missing a `## Test Plan` (or `## Testing Instructions`) section. Add one describing how a reviewer can verify your change, or check `No test plan needed` if no testing is needed.\n </td>\n </tr>\n \n<tr>\n <td>:warning:</td>\n <td>\n\n No Linear issue ID found in this PR's title, description, or branch name (expected something like `ENG-123`). Add one so this work is traceable in Linear, or add `#no-linear` to the PR description to acknowledge it's intentionally untracked.\n </td>\n </tr>\n \n<tr>\n <td>:warning:</td>\n <td>\n\n This PR touches behavior-sensitive code that is documented in [darkmatter/nixmac-web](https://github.com/darkmatter/nixmac-web). Please either:\n- Open a companion docs PR and check **Docs updated** in the PR description, or\n- Check **No docs update needed** if the change doesn't affect user-facing behavior.\n </td>\n </tr>\n </tbody>\n</table>\n\n\n## :clipboard: PR Overview\n\n| | |\n| --- | --- |\n| Lines changed | **274** (+237 / -37) |\n| Files | 0 added, 1 modified, 0 deleted |\n| Draft / WIP | no |\n| Has Test Plan | no |\n| Linear issue | no |\n| No Test Plan Needed | no |\n| New UI components | no |\n| New Storybook stories | no |\n| New Rust modules | no |\n| New TS source files | no |\n| New tests | no |\n| package.json touched | no |\n| Cargo.toml touched | no |\n| Infra / CI touched | no |\n\n\n## :microscope: Coverage\n\n| Report | Lines | Statements | Functions | Branches |\n| --- | --- | --- | --- | --- |\n| `apps/native/coverage/coverage-summary.json` | 35.7% | 35.2% | 31.2% | 30.0% |\n\n<p align=\"right\">\n Generated by :no_entry_sign: <a href=\"https://danger.systems/js\">dangerJS</a> against ba196f2434dcf8c5d3185db93633282b85a56b8f\n</p>\n"
}
},
"issue": {
"url": "https://api.github.com/repos/darkmatter/nixmac/issues/552",
"repository_url": "https://api.github.com/repos/darkmatter/nixmac",
"labels_url": "https://api.github.com/repos/darkmatter/nixmac/issues/552/labels{/name}",
"comments_url": "https://api.github.com/repos/darkmatter/nixmac/issues/552/comments",
"events_url": "https://api.github.com/repos/darkmatter/nixmac/issues/552/events",
"html_url": "https://github.com/darkmatter/nixmac/pull/552",
"id": 4919094331,
"node_id": "PR_kwDOSB6EzM7zXSlm",
"number": 552,
"title": "fix(evolve): break the rejected-done loop and stop doomed sessions early",
"user": {
"login": "arximboldi",
"id": 4521138,
"node_id": "MDQ6VXNlcjQ1MjExMzg=",
"avatar_url": "https://avatars.githubusercontent.com/u/4521138?v=4",
"gravatar_id": "",
"url": "https://api.github.com/users/arximboldi",
"html_url": "https://github.com/arximboldi",
"followers_url": "https://api.github.com/users/arximboldi/followers",
"following_url": "https://api.github.com/users/arximboldi/following{/other_user}",
"gists_url": "https://api.github.com/users/arximboldi/gists{/gist_id}",
"starred_url": "https://api.github.com/users/arximboldi/starred{/owner}{/repo}",
"subscriptions_url": "https://api.github.com/users/arximboldi/subscriptions",
"organizations_url": "https://api.github.com/users/arximboldi/orgs",
"repos_url": "https://api.github.com/users/arximboldi/repos",
"events_url": "https://api.github.com/users/arximboldi/events{/privacy}",
"received_events_url": "https://api.github.com/users/arximboldi/received_events",
"type": "User",
"user_view_type": "public",
"site_admin": false
},
"labels": [],
"state": "open",
"locked": false,
"assignees": [],
"milestone": null,
"comments": 2,
"created_at": "2026-07-18T16:29:09Z",
"updated_at": "2026-07-19T14:46:44Z",
"closed_at": null,
"assignee": null,
"author_association": "CONTRIBUTOR",
"issue_field_values": [],
"type": null,
"active_lock_reason": null,
"draft": false,
"pull_request": {
"url": "https://api.github.com/repos/darkmatter/nixmac/pulls/552",
"html_url": "https://github.com/darkmatter/nixmac/pull/552",
"diff_url": "https://github.com/darkmatter/nixmac/pull/552.diff",
"patch_url": "https://github.com/darkmatter/nixmac/pull/552.patch",
"merged_at": null
},
"body": "In #550 we bring the Eval suite back in shape. This is one of a series of PR's addressing some initial findings running it.\r\n\r\nThis addresses 2 + 3 of the evolve-loop convergence follow-ups (`apps/eval/wip/eval-suite-findings.md` on `jp/eval-fixes`). Companion to #551.\r\n\r\n## Problems\r\n\r\n1. When `done` arrives with unverified edits, the engine replied \"Run build_check with host='<host>'\" — but `build_check` accepts no `host` parameter. gpt-oss-120b takes the hint literally, concludes the tool is broken, and re-calls `done` with near-identical summaries; the rejection text was byte-identical on every repeat, so nothing broke the cycle (baseline case spent iterations 11–25 in this loop).\r\n2. Repeated rejected `done` calls counted toward no limit, so a session stuck in this loop only exits via `maxIterations`, burning the full iteration/token budget (baseline cases 39/44/60: 25 iterations, 265–425k tokens each).\r\n\r\n## Changes (4 commits, each green)\r\n\r\n- **Drop the phantom `host` argument** from the rejection hint (and the now-unused `host_attr` parameter of `process_tool_result`).\r\n- **Refactor:** `build_verified` moves into a `DoneGate` struct so completion-gate state travels together.\r\n- **Escalate repeats:** consecutive rejections are tracked; from the second one the message changes and inlines the last `build_check` failure (or points out `build_check` was never run). Any `build_check` attempt resets the streak.\r\n- **Stop gracefully:** after 3 consecutive rejections the standard limit flow runs — interactive sessions ask the user, non-interactive runs stop with a `LimitReached` summary saying the changes never passed a build check — instead of grinding to `maxIterations`.\r\n\r\n## Testing\r\n\r\n- 4 new unit tests: hint references only real parameters; repeat rejections differ and inline the last build error; `build_check` resets the streak; plus existing done/build-verification tests still pass.\r\n- Full `cargo test` green except the 2 pre-existing sandbox-only `prepare_import_target_*` failures (pass when run normally).\r\n- Eval spot-check (cases 39/44/60, PR1+PR2 binary): no regressions attributable to this change; in this stochastic sample none of the three cases entered the done-rejection loop (they failed via exploration thrash, item 4), so the new paths are exercised by the unit tests rather than this run. Full 28-case sweep is the real re-measure.\n",
"reactions": {
"url": "https://api.github.com/repos/darkmatter/nixmac/issues/552/reactions",
"total_count": 0,
"+1": 0,
"-1": 0,
"laugh": 0,
"hooray": 0,
"confused": 0,
"heart": 0,
"rocket": 0,
"eyes": 0
},
"timeline_url": "https://api.github.com/repos/darkmatter/nixmac/issues/552/timeline",
"performed_via_github_app": null,
"state_reason": null
},
"comment": {
"url": "https://api.github.com/repos/darkmatter/nixmac/issues/comments/5012020430",
"html_url": "https://github.com/darkmatter/nixmac/pull/552#issuecomment-5012020430",
"issue_url": "https://api.github.com/repos/darkmatter/nixmac/issues/552",
"id": 5012020430,
"node_id": "IC_kwDOSB6EzM8AAAABKr1czg",
"user": {
"login": "github-actions[bot]",
"id": 41898282,
"node_id": "MDM6Qm90NDE4OTgyODI=",
"avatar_url": "https://avatars.githubusercontent.com/in/15368?v=4",
"gravatar_id": "",
"url": "https://api.github.com/users/github-actions%5Bbot%5D",
"html_url": "https://github.com/apps/github-actions",
"followers_url": "https://api.github.com/users/github-actions%5Bbot%5D/followers",
"following_url": "https://api.github.com/users/github-actions%5Bbot%5D/following{/other_user}",
"gists_url": "https://api.github.com/users/github-actions%5Bbot%5D/gists{/gist_id}",
"starred_url": "https://api.github.com/users/github-actions%5Bbot%5D/starred{/owner}{/repo}",
"subscriptions_url": "https://api.github.com/users/github-actions%5Bbot%5D/subscriptions",
"organizations_url": "https://api.github.com/users/github-actions%5Bbot%5D/orgs",
"repos_url": "https://api.github.com/users/github-actions%5Bbot%5D/repos",
"events_url": "https://api.github.com/users/github-actions%5Bbot%5D/events{/privacy}",
"received_events_url": "https://api.github.com/users/github-actions%5Bbot%5D/received_events",
"type": "Bot",
"user_view_type": "public",
"site_admin": false
},
"created_at": "2026-07-18T16:30:43Z",
"updated_at": "2026-07-19T14:48:32Z",
"body": "\n<!--\n 0 failure: \n 3 warning: PR description is..., No Linear issue I..., This PR touches b...\n \n 2 markdown notices\n DangerID: danger-id-Danger;\n-->\n\n\n<table>\n <thead>\n <tr>\n <th width=\"50\"></th>\n <th width=\"100%\" data-danger-table=\"true\">Warnings</th>\n </tr>\n </thead>\n <tbody><tr>\n <td>:warning:</td>\n <td>\n\n PR description is missing a `## Test Plan` (or `## Testing Instructions`) section. Add one describing how a reviewer can verify your change, or check `No test plan needed` if no testing is needed.\n </td>\n </tr>\n \n<tr>\n <td>:warning:</td>\n <td>\n\n No Linear issue ID found in this PR's title, description, or branch name (expected something like `ENG-123`). Add one so this work is traceable in Linear, or add `#no-linear` to the PR description to acknowledge it's intentionally untracked.\n </td>\n </tr>\n \n<tr>\n <td>:warning:</td>\n <td>\n\n This PR touches behavior-sensitive code that is documented in [darkmatter/nixmac-web](https://github.com/darkmatter/nixmac-web). Please either:\n- Open a companion docs PR and check **Docs updated** in the PR description, or\n- Check **No docs update needed** if the change doesn't affect user-facing behavior.\n </td>\n </tr>\n </tbody>\n</table>\n\n\n## :clipboard: PR Overview\n\n| | |\n| --- | --- |\n| Lines changed | **276** (+238 / -38) |\n| Files | 0 added, 1 modified, 0 deleted |\n| Draft / WIP | no |\n| Has Test Plan | no |\n| Linear issue | no |\n| No Test Plan Needed | no |\n| New UI components | no |\n| New Storybook stories | no |\n| New Rust modules | no |\n| New TS source files | no |\n| New tests | no |\n| package.json touched | no |\n| Cargo.toml touched | no |\n| Infra / CI touched | no |\n\n\n## :microscope: Coverage\n\n| Report | Lines | Statements | Functions | Branches |\n| --- | --- | --- | --- | --- |\n| `apps/native/coverage/coverage-summary.json` | 36.3% | 35.9% | 31.6% | 30.5% |\n\n<p align=\"right\">\n Generated by :no_entry_sign: <a href=\"https://danger.systems/js\">dangerJS</a> against db5ddcf6cd89f505764b73c63c7920d2c00c3d2e\n</p>\n",
"author_association": "CONTRIBUTOR",
"reactions": {
"url": "https://api.github.com/repos/darkmatter/nixmac/issues/comments/5012020430/reactions",
"total_count": 0,
"+1": 0,
"-1": 0,
"laugh": 0,
"hooray": 0,
"confused": 0,
"heart": 0,
"rocket": 0,
"eyes": 0
},
"performed_via_github_app": {
"id": 15368,
"client_id": "Iv1.05c79e9ad1f6bdfa",
"slug": "github-actions",
"node_id": "MDM6QXBwMTUzNjg=",
"owner": {
"login": "github",
"id": 9919,
"node_id": "MDEyOk9yZ2FuaXphdGlvbjk5MTk=",
"avatar_url": "https://avatars.githubusercontent.com/u/9919?v=4",
"gravatar_id": "",
"url": "https://api.github.com/users/github",
"html_url": "https://github.com/github",
"followers_url": "https://api.github.com/users/github/followers",
"following_url": "https://api.github.com/users/github/following{/other_user}",
"gists_url": "https://api.github.com/users/github/gists{/gist_id}",
"starred_url": "https://api.github.com/users/github/starred{/owner}{/repo}",
"subscriptions_url": "https://api.github.com/users/github/subscriptions",
"organizations_url": "https://api.github.com/users/github/orgs",
"repos_url": "https://api.github.com/users/github/repos",
"events_url": "https://api.github.com/users/github/events{/privacy}",
"received_events_url": "https://api.github.com/users/github/received_events",
"type": "Organization",
"user_view_type": "public",
"site_admin": false
},
"name": "GitHub Actions",
"description": "Automate your workflow from idea to production",
"external_url": "https://help.github.com/en/actions",
"html_url": "https://github.com/apps/github-actions",
"created_at": "2018-07-30T09:30:17Z",
"updated_at": "2026-06-18T16:17:48Z",
"permissions": {
"actions": "write",
"administration": "read",
"artifact_metadata": "write",
"attestations": "write",
"checks": "write",
"code_quality": "write",
"contents": "write",
"copilot_requests": "write",
"deployments": "write",
"discussions": "write",
"drives": "write",
"issues": "write",
"merge_queues": "write",
"metadata": "read",
"models": "read",
"packages": "write",
"pages": "write",
"pull_requests": "write",
"repository_hooks": "write",
"repository_projects": "write",
"security_events": "write",
"statuses": "write",
"vulnerability_alerts": "read"
},
"events": [
"branch_protection_rule",
"check_run",
"check_suite",
"create",
"delete",
"deployment",
"deployment_status",
"discussion",
"discussion_comment",
"fork",
"gollum",
"issues",
"issue_comment",
"label",
"merge_group",
"milestone",
"page_build",
"public",
"pull_request",
"pull_request_review",
"pull_request_review_comment",
"push",
"registry_package",
"release",
"repository",
"repository_dispatch",
"status",
"watch",
"workflow_dispatch",
"workflow_run"
]
},
"minimized": null
},
"repository": {
"id": 1209959628,
"node_id": "R_kgDOSB6EzA",
"name": "nixmac",
"full_name": "darkmatter/nixmac",
"private": false,
"owner": {
"login": "darkmatter",
"id": 17834193,
"node_id": "MDEyOk9yZ2FuaXphdGlvbjE3ODM0MTkz",
"avatar_url": "https://avatars.githubusercontent.com/u/17834193?v=4",
"gravatar_id": "",
"url": "https://api.github.com/users/darkmatter",
"html_url": "https://github.com/darkmatter",
"followers_url": "https://api.github.com/users/darkmatter/followers",
"following_url": "https://api.github.com/users/darkmatter/following{/other_user}",
"gists_url": "https://api.github.com/users/darkmatter/gists{/gist_id}",
"starred_url": "https://api.github.com/users/darkmatter/starred{/owner}{/repo}",
"subscriptions_url": "https://api.github.com/users/darkmatter/subscriptions",
"organizations_url": "https://api.github.com/users/darkmatter/orgs",
"repos_url": "https://api.github.com/users/darkmatter/repos",
"events_url": "https://api.github.com/users/darkmatter/events{/privacy}",
"received_events_url": "https://api.github.com/users/darkmatter/received_events",
"type": "Organization",
"user_view_type": "public",
"site_admin": false
},
"html_url": "https://github.com/darkmatter/nixmac",
"description": "Home manager and nix-darwin that understands plain English",
"fork": false,
"url": "https://api.github.com/repos/darkmatter/nixmac",
"forks_url": "https://api.github.com/repos/darkmatter/nixmac/forks",
"keys_url": "https://api.github.com/repos/darkmatter/nixmac/keys{/key_id}",
"collaborators_url": "https://api.github.com/repos/darkmatter/nixmac/collaborators{/collaborator}",
"teams_url": "https://api.github.com/repos/darkmatter/nixmac/teams",
"hooks_url": "https://api.github.com/repos/darkmatter/nixmac/hooks",
"issue_events_url": "https://api.github.com/repos/darkmatter/nixmac/issues/events{/number}",
"events_url": "https://api.github.com/repos/darkmatter/nixmac/events",
"assignees_url": "https://api.github.com/repos/darkmatter/nixmac/assignees{/user}",
"branches_url": "https://api.github.com/repos/darkmatter/nixmac/branches{/branch}",
"tags_url": "https://api.github.com/repos/darkmatter/nixmac/tags",
"blobs_url": "https://api.github.com/repos/darkmatter/nixmac/git/blobs{/sha}",
"git_tags_url": "https://api.github.com/repos/darkmatter/nixmac/git/tags{/sha}",
"git_refs_url": "https://api.github.com/repos/darkmatter/nixmac/git/refs{/sha}",
"trees_url": "https://api.github.com/repos/darkmatter/nixmac/git/trees{/sha}",
"statuses_url": "https://api.github.com/repos/darkmatter/nixmac/statuses/{sha}",
"languages_url": "https://api.github.com/repos/darkmatter/nixmac/languages",
"stargazers_url": "https://api.github.com/repos/darkmatter/nixmac/stargazers",
"contributors_url": "https://api.github.com/repos/darkmatter/nixmac/contributors",
"subscribers_url": "https://api.github.com/repos/darkmatter/nixmac/subscribers",
"subscription_url": "https://api.github.com/repos/darkmatter/nixmac/subscription",
"commits_url": "https://api.github.com/repos/darkmatter/nixmac/commits{/sha}",
"git_commits_url": "https://api.github.com/repos/darkmatter/nixmac/git/commits{/sha}",
"comments_url": "https://api.github.com/repos/darkmatter/nixmac/comments{/number}",
"issue_comment_url": "https://api.github.com/repos/darkmatter/nixmac/issues/comments{/number}",
"contents_url": "https://api.github.com/repos/darkmatter/nixmac/contents/{+path}",
"compare_url": "https://api.github.com/repos/darkmatter/nixmac/compare/{base}...{head}",
"merges_url": "https://api.github.com/repos/darkmatter/nixmac/merges",
"archive_url": "https://api.github.com/repos/darkmatter/nixmac/{archive_format}{/ref}",
"downloads_url": "https://api.github.com/repos/darkmatter/nixmac/downloads",
"issues_url": "https://api.github.com/repos/darkmatter/nixmac/issues{/number}",
"pulls_url": "https://api.github.com/repos/darkmatter/nixmac/pulls{/number}",
"milestones_url": "https://api.github.com/repos/darkmatter/nixmac/milestones{/number}",
"notifications_url": "https://api.github.com/repos/darkmatter/nixmac/notifications{?since,all,participating}",
"labels_url": "https://api.github.com/repos/darkmatter/nixmac/labels{/name}",
"releases_url": "https://api.github.com/repos/darkmatter/nixmac/releases{/id}",
"deployments_url": "https://api.github.com/repos/darkmatter/nixmac/deployments",
"created_at": "2026-04-14T00:37:13Z",
"updated_at": "2026-07-19T14:38:33Z",
"pushed_at": "2026-07-19T14:47:56Z",
"git_url": "git://github.com/darkmatter/nixmac.git",
"ssh_url": "org-17834193@github.com:darkmatter/nixmac.git",
"clone_url": "https://github.com/darkmatter/nixmac.git",
"svn_url": "https://github.com/darkmatter/nixmac",
"homepage": "https://nixmac.com",
"size": 688775,
"stargazers_count": 21,
"watchers_count": 21,
"language": "Rust",
"has_issues": true,
"has_projects": false,
"has_downloads": true,
"has_wiki": false,
"has_pages": true,
"has_discussions": true,
"forks_count": 2,
"mirror_url": null,
"archived": false,
"disabled": false,
"open_issues_count": 101,
"license": {
"key": "mit",
"name": "MIT License",
"spdx_id": "MIT",
"url": "https://api.github.com/licenses/mit",
"node_id": "MDc6TGljZW5zZTEz"
},
"allow_forking": true,
"is_template": false,
"web_commit_signoff_required": false,
"has_pull_requests": true,
"pull_request_creation_policy": "all",
"topics": [
"home-manager",
"nix",
"nix-darwin",
"nix-flake",
"opencode"
],
"visibility": "public",
"forks": 2,
"open_issues": 101,
"watchers": 21,
"default_branch": "main",
"custom_properties": {}
},
"organization": {
"login": "darkmatter",
"id": 17834193,
"node_id": "MDEyOk9yZ2FuaXphdGlvbjE3ODM0MTkz",
"url": "https://api.github.com/orgs/darkmatter",
"repos_url": "https://api.github.com/orgs/darkmatter/repos",
"events_url": "https://api.github.com/orgs/darkmatter/events",
"hooks_url": "https://api.github.com/orgs/darkmatter/hooks",
"issues_url": "https://api.github.com/orgs/darkmatter/issues",
"members_url": "https://api.github.com/orgs/darkmatter/members{/member}",
"public_members_url": "https://api.github.com/orgs/darkmatter/public_members{/member}",
"avatar_url": "https://avatars.githubusercontent.com/u/17834193?v=4",
"description": ""
},
"enterprise": {
"id": 469843,
"slug": "darkmatter",
"name": "darkmatter",
"node_id": "E_kgDOAAcrUw",
"avatar_url": "https://avatars.githubusercontent.com/b/469843?v=4",
"description": "",
"website_url": "darkmatter.io",
"html_url": "https://github.com/enterprises/darkmatter",
"created_at": "2025-09-07T16:01:00Z",
"updated_at": "2026-07-07T15:59:26Z"
},
"sender": {
"login": "github-actions[bot]",
"id": 41898282,
"node_id": "MDM6Qm90NDE4OTgyODI=",
"avatar_url": "https://avatars.githubusercontent.com/in/15368?v=4",
"gravatar_id": "",
"url": "https://api.github.com/users/github-actions%5Bbot%5D",
"html_url": "https://github.com/apps/github-actions",
"followers_url": "https://api.github.com/users/github-actions%5Bbot%5D/followers",
"following_url": "https://api.github.com/users/github-actions%5Bbot%5D/following{/other_user}",
"gists_url": "https://api.github.com/users/github-actions%5Bbot%5D/gists{/gist_id}",
"starred_url": "https://api.github.com/users/github-actions%5Bbot%5D/starred{/owner}{/repo}",
"subscriptions_url": "https://api.github.com/users/github-actions%5Bbot%5D/subscriptions",
"organizations_url": "https://api.github.com/users/github-actions%5Bbot%5D/orgs",
"repos_url": "https://api.github.com/users/github-actions%5Bbot%5D/repos",
"events_url": "https://api.github.com/users/github-actions%5Bbot%5D/events{/privacy}",
"received_events_url": "https://api.github.com/users/github-actions%5Bbot%5D/received_events",
"type": "Bot",
"user_view_type": "public",
"site_admin": false
},
"installation": {
"id": 131074261,
"node_id": "MDIzOkludGVncmF0aW9uSW5zdGFsbGF0aW9uMTMxMDc0MjYx"
}
}