Skip to content

Conversation

@jefchien
Copy link
Member

Description: Removes the scheduled performance tests. Also, auto-commits results to gh-pages and updates benchmarking.

Link to tracking Issue: #811

Testing: Tested it with my fork.

Documentation:

@jefchien jefchien requested a review from a team as a code owner December 20, 2021 20:33
@codecov-commenter
Copy link

codecov-commenter commented Dec 20, 2021

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 51.93%. Comparing base (7c7ef3f) to head (3bf3652).
Report is 1022 commits behind head on main.

❗ Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #818      +/-   ##
==========================================
- Coverage   55.14%   51.93%   -3.22%     
==========================================
  Files          11       11              
  Lines         301      387      +86     
==========================================
+ Hits          166      201      +35     
- Misses        118      169      +51     
  Partials       17       17              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

run: python e2etest/get-performance-model-table.py ${{ needs.get-testing-version.outputs.testing_version }}

- name: Store benchmark result
uses: jefchien/[email protected]
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Anyway for us to know the parameters that are required in your private GitHub action thought?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's a fork of the existing https://github.com/benchmark-action/github-action-benchmark. The change was needed to pass the workflow dispatch input SHA into the action so the benchmarks are tagged with the correct commit. I have a PR benchmark-action/github-action-benchmark#93 open for the change, but until that gets merged or another method of inserting the commit is found, we'll need to use the fork.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Got cha. Make more sense to me now. Currently reviewing yours other PR as well.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add a comment

"""
Splits models by test
"""
benchmark_data = []
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IMO, instead of using only [], using list(dict) would have more clarification in defining what is added into the list.

@jefchien jefchien force-pushed the auto-perf-test branch 2 times, most recently from 15f8e93 to b50f8a6 Compare December 22, 2021 23:35
@jefchien jefchien merged commit c926da5 into aws-observability:main Dec 23, 2021
@jefchien jefchien deleted the auto-perf-test branch December 23, 2021 16:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants