xhs小红书爬虫时遇到报错导致中断 #448
luyixiao31
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
python main.py --platform xhs --lt qrcode --type search
爬取23篇笔记后,部分报错内容如下:
Traceback (most recent call last):
File "D:\Anaconda3\envs\mdcrawler\lib\site-packages\httpcore_exceptions.py", line 10, in map_exceptions
yield
File "D:\Anaconda3\envs\mdcrawler\lib\site-packages\httpcore_async\http11.py", line 197, in _receive_event
event = self._h11_state.next_event()
File "D:\Anaconda3\envs\mdcrawler\lib\site-packages\h11_connection.py", line 469, in next_event
event = self._extract_next_receive_event()
File "D:\Anaconda3\envs\mdcrawler\lib\site-packages\h11_connection.py", line 419, in _extract_next_receive_event
event = self._reader.read_eof() # type: ignore[attr-defined]
File "D:\Anaconda3\envs\mdcrawler\lib\site-packages\h11_readers.py", line 137, in read_eof
raise RemoteProtocolError(
h11._util.RemoteProtocolError: peer closed connection without sending complete message body (received 2097152 bytes, expected 71692919)
是不是爬虫被发现了
Beta Was this translation helpful? Give feedback.
All reactions