Avoiding bot detection

[BryanWall]

I just had this happen on the Under Armour web site. I am using the Selenium webdriver. Do you have any suggestions for how to avoid the bot detection? I Googled handling cookies through Selenium but I'm not sure if changedetection is already doing that, so I'm posting here before going too far down a rabbit hole.

  Please verify you are a human

  Access to this page has been denied because we believe you are using automation tools to browse the website.

  This may happen as a result of the following:

    * Javascript is disabled or blocked by an extension (ad blockers for example)
    * Your browser does not support cookies

  Please make sure that Javascript and cookies are enabled on your browser and that you are not blocking them from loading.

  Reference ID: xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx

  Powered by PerimeterX , Inc.

[dgtlmoon]

hmm URL? I'll try it on our paid instances

[BryanWall]

https://www.underarmour.com/en-us/c/mens/new-arrivals/running-clothing-shorts/?prefn1=size&prefv1=M

I assume the particular URL doesn't matter, anything on their store with search or filter parameters should act the same. I've monitored several URL's on their site for a couple of weeks, this is the first time it has triggered their bot detection.

Does the way cd calls the webdriver allow cookies? I found some stackoverflow discussions around Selenium and cookies, but don't know if any of those situations apply.

[dgtlmoon]

I guess their firewall spotted your activity...

[dgtlmoon]

looks ok from the paid setup.. but maybe they spot the traffic

i would love to connect it up to something like Tor with a random delay and useragent