Skip to content

Conversation

@Hweinstock
Copy link
Contributor

@Hweinstock Hweinstock commented Nov 21, 2024

Problem

There are many unreliable test issues on github, but they sometimes take different formats. This can make them harder to find, and more difficult to work on. Ideally, all should show up here: https://github.com/aws/aws-toolkit-vscode/issues?q=is%3Aissue+is%3Aopen+unreliable+test in some consistent format.

Solution

See template
Example using template: #6078


License: I confirm that my contribution is made under the terms of the Apache 2.0 license.

@Hweinstock Hweinstock changed the title dev(github): add github issues template for unreliable tests config(github): add github issues template for unreliable tests Nov 21, 2024
@Hweinstock Hweinstock changed the title config(github): add github issues template for unreliable tests docs(github): add github issues template for unreliable tests Nov 21, 2024
@Hweinstock Hweinstock changed the title docs(github): add github issues template for unreliable tests docs(issues): add github issues template for unreliable tests Nov 21, 2024
@Hweinstock Hweinstock marked this pull request as ready for review November 21, 2024 17:25
@Hweinstock Hweinstock requested a review from a team as a code owner November 21, 2024 17:25
@jpinkney-aws
Copy link
Contributor

Maybe a future enhancement could be the github bot labeling and creating issues for flaky tests for us

@Hweinstock
Copy link
Contributor Author

Agreed. Wondering if this can be done without parsing the raw test output as well. Do you know if Mocha provides an easier way?

@Hweinstock Hweinstock merged commit cdccfa2 into aws:master Nov 21, 2024
39 of 62 checks passed
@Hweinstock Hweinstock deleted the flakyTestTemplate branch November 21, 2024 19:19
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants