Skip to content

Improve MNE system prompt: data types and uncertainty handling#254

Merged
neuromechanist merged 2 commits intodevelopfrom
250-improve-mne-system-prompt-supported-data-types-and-i-dont-know-behavior
Mar 9, 2026
Merged

Improve MNE system prompt: data types and uncertainty handling#254
neuromechanist merged 2 commits intodevelopfrom
250-improve-mne-system-prompt-supported-data-types-and-i-dont-know-behavior

Conversation

@neuromechanist
Copy link
Member

Summary

  • Add eye-tracking to MNE supported modalities list and document specialized submodules (mne.preprocessing.eyetracking, mne.preprocessing.nirs)
  • Replace permissive "always attempt to answer" guidance with explicit uncertainty handling: search before claiming support, say "I don't know" when tools return nothing
  • Add eyetracking tutorial to documentation sources (verified URL returns 200)

Test plan

Closes #250

Add eye-tracking to supported modalities, add explicit uncertainty
handling instructions to prevent confabulation, and add the
eyetracking tutorial to documentation sources.

Closes #250
Soften uncertainty instructions to preserve helpfulness while
adding verification emphasis. Update the description field to
include eye-tracking for consistency with the system prompt.
@neuromechanist
Copy link
Member Author

PR Review

Code review found 2 important issues, both addressed in follow-up commit:

  1. Uncertainty handling too restrictive (confidence: 85) - Original replacement broke consistency with base template and other communities. Could cause assistant to refuse answering obvious questions if tool calls return empty. Fixed by softening to additive verification emphasis while preserving helpfulness.

  2. description field not updated (confidence: 82) - Line 6 omitted eye-tracking while system prompt included it. Fixed by updating description to include eye-tracking.

@neuromechanist neuromechanist merged commit e2e452e into develop Mar 9, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant