Help deal with the backlog of `in-testsuite?` flags

[mozfreddyb]

Some ago, I filed #978 to help with the backlog of security bugs with unlanded tests by reminding people to land their tests. The full explanation can be seen in that issue and I recommend skimming it once more.

It looks like this was closed in a forward-looking way that people can use reminders in the future, which is nice.

However, this does not deal with the pre-existing bugs that have no reminder and a reviewed patch attached which has never been landed. It would be nice if we could also solve that.

[mozfreddyb]

CC @suhaibmujahid :)

[suhaibmujahid]

Thank you for following up on this. To make sure that we get things right, could you please elaborate on the condition when BugBot should needinfo from the author?

My understanding is that this should occur when the bug has the in-testsuite? flag and is public. At the same time, it should disregard bugs without open patches.

[mozfreddyb]

We should focus on resolved bugs that have the in-testsuite? flag.

The timing-piece could be solved through various angles

• ideally we can determine that the fix version (based on firefox tracking/status flags) has been released to the public.
• bug is public
• has been resolved ~11 weeks ago

Whatever is easiest, I suppose.