Skip to content

Conversation

@vincetran
Copy link
Member

  • PR title and description conform to Pull Request guidelines.

Issue #, if available: N/A

Description of changes: This change adds a python script which parses the instrumentation logs from Android Test Orchestrator that are retrieved from a Device Farm test run, improves the error reporting in the CodeBuild report UI, generates a Junit report (for CodeBuild report UI), and sends relevant metrics to CloudWatch. This change also modifies the Device Farm schedule-run command to pass in the custom Device Farm TestSpec ARN that we want to use which uses the Android Test Orchestrator rather than the default test runner.

nota bene: This is the Amplify part of a larger change to our internal CodeBuild project in an effort to better understand the state of our integration tests. This dry run for this PR will fail until the changes in the CodeBuild project are done.

How did you test these changes?
I've tested this change in a test AWS account that runs the build E2E on this integ-test-reporting branch. The tests run as expected, the CodeBuild test report is generated and can be read in the UI.

Documentation update required?

  • No
  • Yes (Please include a PR link for the documentation update)

General Checklist

  • Added Unit Tests
  • Added Integration Tests
  • Security oriented best practices and standards are followed (e.g. using input sanitization, principle of least privilege, etc)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@vincetran vincetran requested a review from a team as a code owner March 21, 2025 20:05
@vincetran vincetran merged commit 30c9f26 into main Apr 9, 2025
3 of 4 checks passed
@vincetran vincetran deleted the vincetran/integ-test-reporting branch April 9, 2025 18:11
vincetran added a commit that referenced this pull request Apr 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants