Skip to content

Commit e65e42f

Browse files
Update AI RCA documentation to enhance clarity and detail, renaming "Pattern Filtering" to "Intelligent Targeting" and expanding configuration instructions for targeting rules. Replace the associated image with an updated version.
1 parent 7fcf240 commit e65e42f

File tree

2 files changed

+24
-6
lines changed

2 files changed

+24
-6
lines changed
22.4 KB
Loading

docs/analytics-ai-root-cause-analysis.md

Lines changed: 24 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -128,12 +128,18 @@ Our CRM application has specific failure patterns to watch for:
128128
| **File Processing** | Upload failures, format validation, processing timeouts | When tests involve file operations (imports, exports, attachments) |
129129
| **Network Issues** | Connectivity problems, DNS failures, proxy issues | When tests fail due to network-related problems |
130130

131-
### Step 4: Configure Pattern Filtering
131+
### Step 4: Configure Intelligent Targeting
132132

133-
Use regex patterns to control which tests get RCA analysis:
133+
Configure intelligent targeting rules to precisely control which tests, builds, tags, or jobs are included in AI-powered analysis:
134134

135-
1. **Add Patterns**: Enter regex patterns in the input field
135+
1. **Add Targeting Rules**: Enter regex patterns in the input field
136136
2. **Click Include (+) or Exclude (-)**: Choose whether to include or exclude matching tests
137+
3. **Configure Multiple Criteria**: Set targeting rules for:
138+
- **Test Names**: Target specific test suites or test patterns
139+
- **Build Tags**: Include or exclude builds with specific tags
140+
- **Test Tags**: Include or exclude tests with specific tags (e.g., playwright_test, atxHyperexecute_test)
141+
- **Build Tags**: Include or exclude builds with specific tags (e.g., hourly, nightly)
142+
- **Job Labels**: Include tests with specific job labels or tags
137143

138144
#### Example Configuration
139145

@@ -145,7 +151,19 @@ Use regex patterns to control which tests get RCA analysis:
145151
**Build Tag:**
146152
- **Include**: `^hourly` - Only analyze builds with tag starting with "hourly"
147153

148-
**Result**: RCA analysis will run only on tests with name containing "prod" and not containing "non-critical", from builds with tag starting with "hourly".
154+
**Failure Type:**
155+
- **Include**: `ApiError5xx|ResourceLoadFailure` - Focus on API and resource loading failures
156+
- **Exclude**: `TestScriptError` - Skip script-related errors for this analysis
157+
158+
**Browser/OS:**
159+
- **Include**: `Chrome.*MacOS|Chrome.*Windows` - Target Chrome on Mac and Windows
160+
- **Exclude**: `.*Linux.*` - Skip Linux environments
161+
162+
**Test Tags:**
163+
- **Include**: `playwright_test|atxHyperexecute_test` - Focus on specific test frameworks
164+
- **Exclude**: `.*smoke.*` - Skip smoke tests
165+
166+
**Result**: AI-powered analysis will run only on production tests (excluding non-critical ones) from hourly builds, focusing on API and resource failures in Chrome browsers on Mac/Windows, using Playwright or HyperExecute test frameworks, while excluding smoke tests.
149167
:::
150168

151169

@@ -234,7 +252,7 @@ The RCA Category Trends widget in Insights enables you to:
234252

235253
- **Start with "All failures"** to get comprehensive coverage, then refine based on your needs
236254
- **Use specific special instructions** to guide the AI toward your most critical issues
237-
- **Set up pattern filtering** to focus on relevant test suites and exclude noise
255+
- **Set up intelligent targeting** to focus on relevant test suites and exclude noise
238256

239257
### 2. Interpreting Results
240258

@@ -274,7 +292,7 @@ The RCA Category Trends widget in Insights enables you to:
274292
<summary><strong>Inaccurate RCA Results</strong></summary>
275293

276294
- **Refine special instructions**: Provide more specific context about your application
277-
- **Update pattern filtering**: Exclude irrelevant tests that might confuse the analysis
295+
- **Update intelligent targeting**: Exclude irrelevant tests that might confuse the analysis
278296
- **Review error categorization**: Ensure test failures are properly categorized
279297
- **Provide feedback**: Use any available feedback mechanisms to improve accuracy
280298

0 commit comments

Comments
 (0)