Skip to content

Commit 53fbd4e

Browse files
authored
Merge pull request #10275 from iomimtso/update-can't-see-elements
AB#8530: Add new cause in article UI automation fails and element picker or recorder can't see UI elements
2 parents 81ddb98 + 67f25d4 commit 53fbd4e

File tree

1 file changed

+24
-12
lines changed

1 file changed

+24
-12
lines changed

support/power-platform/power-automate/desktop-flows/ui-automation/element-picker-cant-see-elements.md

Lines changed: 24 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -1,22 +1,34 @@
11
---
2-
title: Troubleshoot UI Element Visibility Issues in Power Automate for Desktop
3-
description: Troubleshoot Power Automate for desktop when it can't interact with specific UI elements. Explore solutions like OCR, image actions, and more.
4-
ms.date: 11/05/2025
2+
title: Troubleshoot UI Automation and Element Detection in Power Automate for Desktop
3+
description: Troubleshoot UI automation issues in Power Automate for desktop. Learn how to fix problems with the element picker or recorder not detecting UI elements.
4+
ms.date: 12/02/2025
55
ms.custom: sap:Desktop flows\UI or browser automation
66
ms.reviewer: iomimtso, nimoutzo, v-shaywood
7+
ms.author: iomimtso
78
---
89

9-
# UI element picker or recorder can't view UI elements in desktop applications
10+
# UI automation fails and element picker or recorder can't see UI elements
1011

11-
This article provides troubleshooting guidance for an issue where Power Automate for desktop can't view or interact with specific UI elements in a desktop application.
12+
This article provides troubleshooting guidance for issues where Power Automate for desktop can't view or interact with specific UI elements in a desktop application.
1213

1314
## Symptoms
1415

15-
When using Power Automate for desktop, the element picker tool can't detect or "see" certain UI elements within desktop applications. This issue prevents you from selecting elements for automation tasks.
16+
When you try to use UI automation in Power Automate for desktop, you might experience the following issues:
1617

17-
## Cause
18+
- _During design time_: The element picker or recorder doesn't show any UI elements when you try to capture elements for automation.
19+
- _During runtime_: UI automation actions fail to execute correctly in both attended and unattended desktop flow runs.
1820

19-
Some desktop applications use custom UI frameworks or rendering methods that aren't compatible with the standard accessibility APIs that Power Automate for desktop relies on. This incompatibility can make certain elements invisible to the element picker.
21+
## Cause 1: Interfering background processes
22+
23+
Some background processes interfere with UI automation functionality in Power Automate for desktop. Specifically, the **Microsoft Accessory Center** or **DesktopBridge** processes prevent UI automation from working correctly.
24+
25+
### Solution: Terminate interfering processes
26+
27+
To resolve this issue, terminate the interfering processes and disable them from running in the future.
28+
29+
## Cause 2: Incompatible UI frameworks
30+
31+
Some desktop applications use custom UI frameworks or rendering methods that aren't compatible with the standard accessibility APIs that Power Automate for desktop relies on. This incompatibility makes certain elements invisible to the element picker.
2032

2133
> [!IMPORTANT]
2234
> For coordinate-based solutions (Solutions [3](#solution-3-use-the-recorder-with-coordinates) and [4](#solution-4-use-move-mouse-and-send-mouse-click-actions)) to work reliably:
@@ -25,7 +37,7 @@ Some desktop applications use custom UI frameworks or rendering methods that are
2537
> - Changes to the application's user interface structure might affect the effectiveness of these workarounds.
2638
> - Test your flows thoroughly when deploying to different machines or environments.
2739
28-
## Solution 1: Use Move mouse to image action
40+
### Solution 1: Use Move mouse to image action
2941

3042
1. Add a **Move mouse to image** action to your flow.
3143
1. Capture an image of the UI element you want to interact with.
@@ -34,7 +46,7 @@ Some desktop applications use custom UI frameworks or rendering methods that are
3446

3547
This action moves the mouse to the first occurrence of the specified image and sends a left click.
3648

37-
## Solution 2: Use Move mouse to text on screen (OCR) action
49+
### Solution 2: Use Move mouse to text on screen (OCR) action
3850

3951
1. Add a **Move mouse to text on screen (OCR)** action to your flow.
4052
1. Specify the text that appears on or near the UI element you want to interact with.
@@ -43,7 +55,7 @@ This action moves the mouse to the first occurrence of the specified image and s
4355

4456
This action uses Optical Character Recognition (OCR) to locate text on the screen or foreground window and sends a mouse click to that location.
4557

46-
## Solution 3: Use the recorder with coordinates
58+
### Solution 3: Use the recorder with coordinates
4759

4860
1. Open Power Automate for desktop and create a new flow.
4961
1. Select **Recorder** from the toolbar.
@@ -52,7 +64,7 @@ This action uses Optical Character Recognition (OCR) to locate text on the scree
5264

5365
The recorder creates a **Click UI element in window** action with coordinate-based input parameters populated by using the respective values from your click action.
5466

55-
## Solution 4: Use Move mouse and Send mouse click actions
67+
### Solution 4: Use Move mouse and Send mouse click actions
5668

5769
1. Add a **Move mouse** action to your flow.
5870
1. Configure the action to move the mouse to the specific coordinates of the target element.

0 commit comments

Comments
 (0)