Providing more information than remark="Fail | Out of Text Editor", e.g. information about looked at pane

[jnareb]

Currently the eye_tracking.xml file offers more info than bare gaze data only for when the gaze falls on the editor pane. Otherwise CodeGRITS adds remark="Fail | Out of Text Editor" and raw gaze data.

Would it be possible and feasible to extract the name of the pane (the part of the JetBrains IDE window) where the gaze falls, and provide it in eye_tracking.xml? For example, I would like to know if "out of text editor" means that:

• the gaze falls outside IDE window
• the gaze falls on "Problems" pane, or "Project" pane, or "Commit", or plugin-provide pane like "AI Chat" - and I would like to know the name of the pane

I would appreciate if you at least pointed me into the right direction.

Thanks in advance.

[TTangNingzhi]

Thanks for the comments! Although I never investigated the exact solution, I know some other researchers are working on something related: main...kaianew:CodeGRITS:main

You may refer to their solution; it seems they made the ToolWindow and SearchEverywhere Popup work! The solution appears first to calculate the boundaries and then record an event when the gaze falls within the boundary.

[jnareb]

You may refer to their solution; it seems they made the ToolWindow and SearchEverywhere Popup work! The solution appears first to calculate the boundaries and then record an event when the gaze falls within the boundary.

Thanks.

I wonder how well that approach works with moving panes, closing and reopening panes, replacing panes with other panes, and resizing panes.