cdp.wait_for_element seems to be freezing despite of the timeout?

[Rapid1898-code]

I am using the cdp mode in that way iterating over many links in that way

with SB(uc=True, proxy=proxy, headless=False) as sb:
    sb.activate_cdp_mode(link)  
    sb.cdp.sleep(WAIT)
    for _ in range(3):
      try: 
        print(f"Wait for element...")
        sb.cdp.wait_for_element('div#cphPrimaryContent_pnlCompany', timeout = 10)        
        sb.cdp.sleep(WAIT)
        soup = BeautifulSoup (sb.cdp.get_page_source(), 'lxml')  
      except Exception as error:
        print(f"Try to solve captcha...")
        sb.cdp.sleep(WAIT)
        sb.cdp.solve_captcha()        
        sb.cdp.sleep(WAIT)
        print(f"Solving captcha finished...")

Generally most of the time this works fine but sometime the program freezes at this wait_for_element statement

sb.cdp.wait_for_element('div#cphPrimaryContent_pnlCompany', timeout = 10)

Due the timeout setting i would say that this should not happens but the program is writing "Wait for element..." and then
nothing happesn anymore.

Is there any way i can do do that in a different way so i can be sure that an exception is thrown when there is any problem finding this element?

[mdmintz]

You could try changing the pageLoadStrategy to "none" via the pls arg, and then you can avoid waiting on pages where content never finishes loading. But otherwise, sleep() when you don't know wait to wait for, and wait_for_element() when you do know what to wait for. And make sure you're using the latest version of SeleniumBase.

[Rapid1898-code]

I am not sure if i fully understand what you mean -

I have to use this statement
sb.cdp.wait_for_element('div#cphPrimaryContent_pnlCompany', timeout = 10)
cause i only can check with that if there is a cloudflare checkbox or the real data
when its throwing an exception i know that i have to solve a captcha with cdp.solve_captcha()
otherwise i can collect the data

So how can i set this: try changing the pageLoadStrategy to "none" via the pls arg
in my python program?

[mdmintz]

It's a SeleniumBase arg:

SeleniumBase/examples/cdp_mode/raw_nike.py

Line 3 in 3e3aa69

with SB(uc=True, test=True, locale="en", pls="none") as sb:

[Rapid1898-code]

Thanks - i will try this out