Skip to content

auto-triage improvements: security improvements, sandbox updates, skill refinements#15545

Open
FredKSchott wants to merge 38 commits intomainfrom
fks/triage-9
Open

auto-triage improvements: security improvements, sandbox updates, skill refinements#15545
FredKSchott wants to merge 38 commits intomainfrom
fks/triage-9

Conversation

@FredKSchott
Copy link
Member

@FredKSchott FredKSchott commented Feb 16, 2026

Changes

  • New: Add proxies support to the triage workflow. Replaces manual GH_TOKEN env passing with a safer github proxy from @flue/client/proxies.
  • Chore: Improve triage skills — add explicit SCOPE instructions to all sub-skills, promote git blame in verify skill, refine comment template formatting.
  • Chore: Improve AGENTS.md - add environment guide (prefer node -e over python), add bgproc (by @ascorbic!) to help agents manage background dev servers.
  • Chore: Bump @flue/cli to 0.0.43 and @flue/client to 0.0.27.

And two unrelated things:

  • New: Add analyze-github-action-logs skill for debugging CI logs. Useful for powering a prompt like "review the last 10 completed github action runs of type XXX for issues or potential improvements"
  • Refactor: Clean up our other issue-* workflows (issue-opened, issue-needs-repro, issue-wontfix).

Testing

No good way to test CI locally, will need to test post-merge.

Docs

No docs needed.

@changeset-bot
Copy link

changeset-bot bot commented Feb 16, 2026

⚠️ No Changeset found

Latest commit: c4ce188

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

@FredKSchott FredKSchott changed the title [WIP] auto-triage improvements: gh CLI proxy, sandbox updates, skill refinements [WIP] auto-triage improvements: security improvements, sandbox updates, skill refinements Feb 16, 2026
@matthewp
Copy link
Contributor

Can you make it check if the issue is a duplicate? This is an example of one that is: #15518

@github-actions github-actions bot added the 🚨 action Modifies GitHub Actions label Feb 18, 2026
@FredKSchott FredKSchott marked this pull request as ready for review February 19, 2026 05:48
@FredKSchott FredKSchott changed the title [WIP] auto-triage improvements: security improvements, sandbox updates, skill refinements auto-triage improvements: security improvements, sandbox updates, skill refinements Feb 19, 2026
@FredKSchott
Copy link
Member Author

Can you make it check if the issue is a duplicate? This is an example of one that is: #15518

Would love to do this in the future.

@ascorbic
Copy link
Contributor

Aside from the skills, a lot of the stuff in here is quite generic. Would the plan be to eventually abstract that away into an action, or inside Flue?

Copy link
Member

@ematipico ematipico left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Left some feedback, but I feel strongly about global installations. Please revert for now, or change the strategy to a better setting

Note: Edits to source files take effect after rebuilding the package via `pnpm build`.
Edits to source files take effect after rebuilding the package via `pnpm build`.

Use `pnpm -C <dir> <command>` for project-local script commands when working in packages/examples/triage directories (Example: `pnpm -C packages/astro build`, `pnpm -C examples/blog dev`). Only omit `-C` flag when intentionally working in the monorepo root (Example: `pnpm format`, `pnpm lint`, `pnpm test:types`).
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The examples directory isn't part of the workspace, it should be excluded

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the examples folder is connected to the workspace? https://github.com/withastro/astro/blob/main/pnpm-workspace.yaml#L4

Comment on lines +64 to +67
1. `pnpm exec bgproc start -n devserver --wait-for-port 10 --force -- pnpm -C examples/minimal dev` - Start the dev server
2. `pnpm exec bgproc logs -n devserver` - View logs from the dev server. Useful for debugging server logs.
3. `pnpm exec bgproc stop -n devserver` - Stop when dev server when your work is complete
4. `pnpm exec bgproc list` - List all running servers, background processes. Useful for cleanup.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Change the example. The examples folder isn't connected to the workspace, so it won't work in debugging. Instead, instruct the agent to run a fixture this way, which is more useful during development and testing

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

the examples folder is connected to the workspace? https://github.com/withastro/astro/blob/main/pnpm-workspace.yaml#L4

Comment on lines +56 to +60
# `bgproc`

Use `pnpm exec bgproc` to start, stop, and manage long-running `astro dev` & `astro preview` servers in the background. Do not manually start detatched servers with `&` if you can use `bgproc` instead.

Use `pnpm exec bgproc --help` to see all available commands.
Copy link
Member

@ematipico ematipico Feb 19, 2026

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I really don't understand the point of running the background thing. We have already pnpm dev in the workspace AND per library. The agent can run the build in the background for "continuous build" and then run the test.

If you're still set on this way of working, then I suggest explicitly setting what's the purpose, and when the agent should use it

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

image

Proven to help, in CI and local. Agents are not good at managing detatched servers, IME

3. `agent-browser click @e1` / `fill @e2 "text"` - Interact using refs
4. Re-snapshot after all page changes, navigations, interactions.

Note: `agent-browser` should be installed globally, and is not a dependency of this monorepo. If `agent-browser` isn't available on this machine, ask the user to run `npm install -g agent-browser && agent-browser install`. If you are running in headless mode with no human operator and need this tool to complete your job, it is best to fail the job vs. trying to work around not having the tool.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would avoid these instructions. We're basically giving consensus to the agent of installing things globally to the users machines. Then if someone has npm I -g allowed, it gets worse. Please consider changing the strategy here

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TBC this is already in the AGENTS.md file, I'm just reformatting our existing AGENTS.md file here which is why it appears as a diff.

Can we not block this PR (which just reformats / moves it?) and then address as a fast-follow? I don't think the concern is as dramatic as what you're saying but I'm happy to address separately.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

🚨 action Modifies GitHub Actions

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants

Comments