feat: load review methodology from factory-mono builtin skill#64
feat: load review methodology from factory-mono builtin skill#64factory-nizar wants to merge 4 commits intodevfrom
Conversation
a3eefc9 to
0d493c4
Compare
07f09c6 to
7e4fc66
Compare
|
Droid finished @factory-nizar's task —— View job Droid reviewed this PR and found 3 issues (3 P1). Summary: The skill-loader integration has a genuine path-resolution bug (HOME fallback to |
There was a problem hiding this comment.
The skill-loader integration has a genuine path-resolution bug (HOME fallback to ~ doesn't expand in Node/Bun) and both prompt templates can silently lose their review methodology when skill loading fails, since the previously hardcoded guidance was removed without a fallback. Consider using os.homedir() and either failing fast on missing skills or keeping a minimal inlined methodology.
7e4fc66 to
7c007f8
Compare
jonathan-factory
left a comment
There was a problem hiding this comment.
Looks good, might be good to confirm that the plugin gets properly loaded before the action runs
Possible that it only gets installed in interactive mode
|
i'll test on the mono-repo now that the plugin is merged! |
dba8f95 to
cd082dd
Compare
cd082dd to
bcc5b7a
Compare
Load the review skill's shared methodology from factory-mono's builtin-skills/review/SKILL.md instead of keeping it inline in the CI prompt templates. The skill is loaded at runtime via local plugin cache or GitHub fallback. The shared methodology (bug patterns, reporting gate, confidence calibration, deduplication, analysis discipline) is extracted via BEGIN_SHARED_METHODOLOGY / END_SHARED_METHODOLOGY markers and injected into both candidate and validator prompts. Suggestion block rules remain controlled by the include_suggestions toggle at the CI template level. Depends on: Factory-AI/factory-mono#11498 Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>
bcc5b7a to
6465fba
Compare
The Droid CLI bundles the review skill as a builtin, so the agent can invoke it via the Skill tool at runtime. Remove the load-skill.ts GitHub fetch and instead instruct the agent to invoke the 'review' skill directly. This eliminates the network dependency during the prepare step and uses the CLI as the single source of truth for the review methodology. Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>
61e6660 to
03cb28b
Compare
CI VerificationTested end-to-end on factory-mono PR #11503 which points Results
Log evidenceCandidate pass prompt: Validator pass prompt: CLI exec command: |
…skill Both candidate and validator prompts now only provide: - Session framing (senior engineer / validating candidates) - PR context and file paths - Skill invocation instruction (Pass 1 or Pass 2) - CI-specific output schema and posting constraints All review methodology, triage, parallel review, validation rules, deduplication, and confidence filtering come from the skill. Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>
| ## CRITICAL REQUIREMENTS | ||
| ### Critical Requirements | ||
|
|
||
| 1. You MUST read and validate **every** candidate before posting anything. |
There was a problem hiding this comment.
These are ci specfic
CI Verification (Final — With Code Smell Test)Tested end-to-end on factory-mono PR #11503 with a deliberate code smell file to verify skill-driven findings. Workflow Run: PassedLog EvidenceCandidate pass: Validator pass: What This Proves
|
Allows using a custom CLI build for testing builtin skills from unreleased branches. Co-authored-by: factory-droid[bot] <138933559+factory-droid[bot]@users.noreply.github.com>
Bundle Verification — Builtin Review SkillBuilt CLI from CI Run — PassedBuild step output:
Review step output: Both passes completed successfully. Once factory-mono PR #11498 merges, the released CLI will include the builtin skill and the |
Summary
Migrates review methodology from inline prompts to the
reviewbuiltin skill in factory-mono (PR #11498).Changes
reviewskill for Pass 1 (candidate generation) and Pass 2 (validation)load-skill.ts— no GitHub fetch needed, CLI bundles the skill as a builtinsenior staff software engineer/validating candidate review comments) for session queryinginclude_suggestions(defaultstruefor CI)Depends on
Verified