You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@@ -90,7 +70,7 @@ To get started add the following to your workflow file:
90
70
91
71
## Report Showcase
92
72
93
-
Checkout all the built-in reports [here](docs/report-showcase.md)
73
+
Checkout the [built-in reports](docs/report-showcase.md)
94
74
95
75
## Visual Overview
96
76
@@ -102,7 +82,7 @@ Checkout all the built-in reports [here](docs/report-showcase.md)
102
82
103
83
You need a CTRF or JUnit report.
104
84
105
-
This reporter works best with a CTRF as it's packed with modern properties. [CTRF reporters](https://ctrf.io/integrations) are available for most testing frameworks and easy to install.
85
+
This reporter works best with CTRF as it's packed with modern properties. [CTRF reporters](https://ctrf.io/integrations) are available for most testing frameworks and easy to install.
106
86
107
87
For more details on using JUnit, see [JUnit integration instructions](docs/integrations.md#junit-to-ctrf-integration)
108
88
@@ -176,12 +156,97 @@ For more advanced usage, there are several inputs available.
176
156
group-by: 'filePath'# Specify grouping for applicable reports (e.g., suite or file path). Default is filePath
177
157
always-group-by: false # Force grouping by suite or file path for all reports. Default is false
178
158
report-order: 'summary-report,failed-report,flaky-report,skipped-report,test-report'# Comma-separated list of report types to specify the order in which reports should be displayed
159
+
ai: '{}'# JSON configuration for AI-powered test analysis. See AI Configuration section below
179
160
integrations-config: '{}'# JSON configuration for integrations with other developer tools
180
161
if: always()
181
162
```
182
163
183
164
Only `report-path` is required.
184
165
166
+
## Generating an AI Report
167
+
168
+
You can generate human-readable AI reports for your failed tests using models
169
+
from the leading AI providers. The GitHub Test Reporter now features dedicated
170
+
AI-first configuration for seamless integration with continuous AI workflows.
171
+
172
+
### AI Configuration
173
+
174
+
Use the `ai` input to configure AI-powered test analysis. Simply provide a JSON object
175
+
with the provider and any optional settings:
176
+
177
+
```yaml
178
+
- name: Publish Test Report with AI Analysis
179
+
uses: ctrf-io/github-test-reporter@v1
180
+
with:
181
+
report-path: './ctrf/*.json'
182
+
github-report: true
183
+
ai: |
184
+
{
185
+
"provider": "openai",
186
+
"model": "gpt-4",
187
+
"temperature": 0.7,
188
+
"maxTokens": 2000
189
+
}
190
+
env:
191
+
OPENAI_API_KEY: ${{ secrets.OPENAI_API_KEY }}
192
+
if: always()
193
+
```
194
+
195
+
### Supported AI Providers
196
+
197
+
The following AI providers are supported:
198
+
199
+
- **openai** - OpenAI (GPT-4, GPT-3.5, etc.)
200
+
- **claude** - Anthropic Claude
201
+
- **gemini** - Google Gemini
202
+
- **azure-openai** - Azure OpenAI Service
203
+
- **grok** - xAI Grok
204
+
- **deepseek** - DeepSeek
205
+
- **mistral** - Mistral AI
206
+
- **perplexity** - Perplexity AI
207
+
- **openrouter** - OpenRouter (access to multiple models)
You can add a pull request comment by using the `pull-request-report` input:
@@ -409,17 +474,12 @@ CTRF tooling offers seamless developer tool integration, allowing you to combine
409
474
|------------|-------------|------------|
410
475
| Slack Test Reporter | Send test results and notifications to Slack channels | [ctrf-io/slack-test-reporter](https://github.com/ctrf-io/slack-test-reporter) |
411
476
| Microsoft Teams Test Reporter | Post test results and alerts to Teams channels | [ctrf-io/teams-test-reporter](https://github.com/ctrf-io/teams-test-reporter) |
412
-
| AI Test Reporter | Intelligent test analysis using leading AI models | [ctrf-io/ai-test-reporter](https://github.com/ctrf-io/ai-test-reporter) |
413
477
414
478
For detailed information about configuring and using these integrations, see our [Integrations Documentation](docs/integrations.md).
415
479
416
480
Integrations are currently in beta. Please report any issues to the [GitHub Test Reporter repository](https://github.com/ctrf-io/github-test-reporter/issues).
417
481
418
-
## Generating an AI Report
419
482
420
-
You can generate human-readable AI report for your failed tests using models
421
-
from the leading AI providers by using the AI Test Reporter integration or the
422
-
[AI Test Reporter](https://github.com/ctrf-io/ai-test-reporter) directly.
0 commit comments