RSS feed broken due to Cloudflare anti-bot captcha. #542
Description
Hi,
The endpoint https://ctftime.org/event/list/upcoming/rss/ is now protected by Cloudflare and thus, not easily reachable with automated tools.
[ecomaikgolf@laptop ~/]$ curl 'https://ctftime.org/event/list/upcoming/rss/'
<!DOCTYPE html><html lang="en-US"><head><title>Just a moment...</title><meta http-equiv="Content-Type" content="text/html; charset=UTF-8"><meta http-equiv="X-UA-Compatible" content="IE=Edge"><meta name="robots" content="noindex,nofollow"><meta name="viewport" content="width=device-width,initial-scale=1"><style>*{box-sizing:border-box;margin:0;padding:0}html{line-height:1.15;-webkit-text-size-adjust:100%;color:#313131;font-family:system-ui,-apple-system,BlinkMacSystemFont,"Segoe UI",Roboto,"Helvetica
[...]
role="main"><div class="main-content"><noscript><div class="h2">
<span id="challenge-error-text">Enable JavaScript and cookies to continue</span></div></noscript></div></div><script>
(function(){window._cf_chl_opt = {cvId: '3',cZone: 'ctftime.org',cType: 'managed',cRay: '9aacdd919edf5afa',cH: 'HWcK1W3_8Pm5xihvsdl_5L1u1B2v2__Wgt4h7lbXb04-1765203228-1.2.1.1-
[...]
document.createElement('script');a.src = '/cdn-cgi/challenge-platform/h/g/orchestrate/chl_page/v1?ray=9aacdd919edf5afa';window._cf_chl_opt.cOgUHash = location.hash === '' && location.href.indexOf('#') !== -1 ? '#' : location.hash;window._cf_chl_opt.cOgUQuery = location.search === ''
&& location.href.slice(0, location.href.length - window._cf_chl_opt.cOgUHash.length).indexOf('?') !== -1 ? '?' : location.search;if (window.history && window.history.replaceState) {var ogU = location.pathname + window._cf_chl_opt.cOgUQuery +
window._cf_chl_opt.cOgUHash;history.replaceState(null, null,"\/event\/list\/upcoming\/rss\/?__cf_chl_rt_tk=bv2YoXUwfnCIe2Mo2et3JKNdm5HJ6QYLDKrBn4btLpM-176
[ecomaikgolf@laptop ~/]$ ctftime-list +20
<Response [403]>
[!] Error fetching RSS feed
Opening an issue as this could be unintended: it would destroy the initial purpose of an RSS feed. It probably breaks most/all RSS readers consuming the CTFTime feed.
I personally noticed as I heavily use the CTFTime RSS feed for checking upcoming CTFs.
Maybe that specific endpoint should be an exception.