You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This commit adds benchmark_regression_test.yml workflow that runs a
regression test by comparing the benchmark results of the current branch
with the previous benchmark results of the code in main branch.
Signed-off-by: Arjun Raja Yogidas <[email protected]>
if sudo ${{ github.workspace }}/scripts/check_regression.sh ${{ github.workspace }}/previous/benchmark-result-artifact/results.json ${{github.workspace}}/benchmark/performanceTest/output/results.json; then
59
+
echo "Comparison successful. All P90 values are within the acceptable range."
60
+
else
61
+
echo "Comparison failed. Current P90 values exceed 110% of the corresponding past values."
62
+
echo "regression-detected=true" >> $GITHUB_OUTPUT
63
+
fi
64
+
65
+
- name: Stop the workflow if regression is detected
0 commit comments