htmltest for che-docs PR checks fails on false positives #23695
Description
Is your task related to a problem? Please describe
htmltest library is used in che-docs CI processes, to verify that links are pointing to real resources, that have not been moved or deleted. Lately is has been failing on too many false positives (with the links in question are not broken, when re-checked manually).
It seems that the way htmltest sends its requests, they are being intercepted by anti-crawler/scraping services.
Describe the solution you'd like
we should find a fix for htmltest, so that we keep using it for our broken link checking process.
we could also consider temporary disabling it, or make it not fail our CI pipelines, while the solution is being worked on
Describe alternatives you've considered
Consider other libraries and services (GH actions?) that can perform broken link checking
Additional context
No response