Skip to content

Conversation

@JennyPng
Copy link
Member

@JennyPng JennyPng commented Nov 7, 2025

Azure/azure-sdk-tools#12592

explicit:
image

before running another tool:
image

non-mcp related queries (it doesn't try to run the tool)
image

image

ack:

  • We want this check to be proactive and happen without explicit invokation. However, currently, Copilot would only remember if the tool is run in the current session, not in newer sessions, so it could be annoying for the user to constantly have to verify setup in new sessions due to a lack of a caching. This will be accepted for Scenario 1 and improved in future iterations
  • LLM performs better with the relative link to instructions

@JennyPng JennyPng marked this pull request as ready for review November 7, 2025 19:21
Copilot AI review requested due to automatic review settings November 7, 2025 19:21
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR updates the Copilot instructions to enforce environment verification before proceeding with development operations. The change adds a mandatory step to run the azsdk_verify_setup tool to validate the user's development environment.

Key Changes

  • Adds a requirement to run azsdk_verify_setup tool before any other operations in Rule 3

Copy link
Member

@maririos maririos left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • In the context of a repo, is the language passed to the request, so the tool doesn't verify environment conditions that don't apply? like .NET tooling for Python work.
  • Curious, what does classify as an operation?
  • How much time is added to the process if this is going to run in every operation?

@JennyPng
Copy link
Member Author

JennyPng commented Nov 10, 2025

  • In the context of a repo, is the language passed to the request, so the tool doesn't verify environment conditions that don't apply? like .NET tooling for Python work.
  • Curious, what does classify as an operation?
  • How much time is added to the process if this is going to run in every operation?

@maririos

  • Yes, the tool should only check Python (and core) requirements in the Python repo, unless the user explicitly specifies other languages
  • My intention is for Copilot to suggest this tool before running other MCP tools in the current session - operation isn't really an official term, I'll reword this part actually; in general I just struggled to find terms that would make Copilot actually do what I wanted it to do
  • From my testing so far, it suggests to verify setup at the start of the session - but if the user stays in the session and continues requesting other MCP tools, it doesn't try to run it again. Depending on the language, the tool around 3-15 seconds?

@JennyPng JennyPng enabled auto-merge (squash) November 11, 2025 22:05
@JennyPng
Copy link
Member Author

/check-enforcer override

@JennyPng JennyPng merged commit 92b4f1e into Azure:main Nov 11, 2025
14 of 16 checks passed
@JennyPng JennyPng deleted the env-setup-instr branch November 11, 2025 22:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants