You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Update AI RCA documentation to enhance clarity and detail, renaming "Pattern Filtering" to "Intelligent Targeting" and expanding configuration instructions for targeting rules. Replace the associated image with an updated version.
Copy file name to clipboardExpand all lines: docs/analytics-ai-root-cause-analysis.md
+24-6Lines changed: 24 additions & 6 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -128,12 +128,18 @@ Our CRM application has specific failure patterns to watch for:
128
128
|**File Processing**| Upload failures, format validation, processing timeouts | When tests involve file operations (imports, exports, attachments) |
129
129
|**Network Issues**| Connectivity problems, DNS failures, proxy issues | When tests fail due to network-related problems |
130
130
131
-
### Step 4: Configure Pattern Filtering
131
+
### Step 4: Configure Intelligent Targeting
132
132
133
-
Use regex patterns to control which tests get RCA analysis:
133
+
Configure intelligent targeting rules to precisely control which tests, builds, tags, or jobs are included in AI-powered analysis:
134
134
135
-
1.**Add Patterns**: Enter regex patterns in the input field
135
+
1.**Add Targeting Rules**: Enter regex patterns in the input field
136
136
2.**Click Include (+) or Exclude (-)**: Choose whether to include or exclude matching tests
137
+
3.**Configure Multiple Criteria**: Set targeting rules for:
138
+
-**Test Names**: Target specific test suites or test patterns
139
+
-**Build Tags**: Include or exclude builds with specific tags
140
+
-**Test Tags**: Include or exclude tests with specific tags (e.g., playwright_test, atxHyperexecute_test)
141
+
-**Build Tags**: Include or exclude builds with specific tags (e.g., hourly, nightly)
142
+
-**Job Labels**: Include tests with specific job labels or tags
137
143
138
144
#### Example Configuration
139
145
@@ -145,7 +151,19 @@ Use regex patterns to control which tests get RCA analysis:
145
151
**Build Tag:**
146
152
-**Include**: `^hourly` - Only analyze builds with tag starting with "hourly"
147
153
148
-
**Result**: RCA analysis will run only on tests with name containing "prod" and not containing "non-critical", from builds with tag starting with "hourly".
154
+
**Failure Type:**
155
+
-**Include**: `ApiError5xx|ResourceLoadFailure` - Focus on API and resource loading failures
156
+
-**Exclude**: `TestScriptError` - Skip script-related errors for this analysis
157
+
158
+
**Browser/OS:**
159
+
-**Include**: `Chrome.*MacOS|Chrome.*Windows` - Target Chrome on Mac and Windows
160
+
-**Exclude**: `.*Linux.*` - Skip Linux environments
161
+
162
+
**Test Tags:**
163
+
-**Include**: `playwright_test|atxHyperexecute_test` - Focus on specific test frameworks
164
+
-**Exclude**: `.*smoke.*` - Skip smoke tests
165
+
166
+
**Result**: AI-powered analysis will run only on production tests (excluding non-critical ones) from hourly builds, focusing on API and resource failures in Chrome browsers on Mac/Windows, using Playwright or HyperExecute test frameworks, while excluding smoke tests.
149
167
:::
150
168
151
169
@@ -234,7 +252,7 @@ The RCA Category Trends widget in Insights enables you to:
234
252
235
253
-**Start with "All failures"** to get comprehensive coverage, then refine based on your needs
236
254
-**Use specific special instructions** to guide the AI toward your most critical issues
237
-
-**Set up pattern filtering** to focus on relevant test suites and exclude noise
255
+
-**Set up intelligent targeting** to focus on relevant test suites and exclude noise
238
256
239
257
### 2. Interpreting Results
240
258
@@ -274,7 +292,7 @@ The RCA Category Trends widget in Insights enables you to:
0 commit comments