【中国海关】网站改版 TimeoutError: Waiting for selector .pubCon failed: Waiting failed: 30000ms exceeded

[KwToPA]

路由地址

/gov/customs/list/:gchannel?

完整路由地址

/gov/customs/list/paimai

/gov/customs/list/fagui

相关文档

https://docs.rsshub.app/zh/routes/government#%E6%8B%8D%E5%8D%96%E4%BF%A1%E6%81%AF-%E6%B5%B7%E5%85%B3%E6%B3%95%E8%A7%84

预期是什么？

拍卖信息 / 海关法规 正常工作

实际发生了什么？

网站改版导致报错

TimeoutError: Waiting for selector .pubCon failed: Waiting failed: 30000ms exceeded

部署

RSSHub 演示 (https://rsshub.app)

部署相关信息

No response

额外信息

网站已经不禁止境外IP

这不是重复的 issue

• 我已经搜索了 现有 issue，以确保该错误尚未被报告。

[github-actions]

Searching for maintainers:

• /gov/customs/list/:gchannel?: @Jeason0228 @TonyRL @he1q

To maintainers: if you are not willing to be disturbed, list your username in scripts/workflow/test-issue/call-maintainer.js. In this way, your username will be wrapped in an inline code block when tagged so you will not be notified.

If all routes can not be found, the issue will be closed automatically. Please use NOROUTE for a route-irrelevant issue or leave a comment if it is a mistake.
如果所有路由都无法匹配，issue 将会被自动关闭。如果 issue 和路由无关，请使用 NOROUTE 关键词，或者留下评论。我们会重新审核。

[cscnk52]

Work as expect, please check your RSSHub instance.

[KwToPA]

Work as expect, please check your RSSHub instance.

@cscnk52

你好， 以海关拍卖为例，http://www.customs.gov.cn/customs/302249/zfxxgk/2799825/2799883/index.html 可以用美国IP打开

但是在同IP的vps上自建rsshub，报错

Error: Could not find Chrome (ver. 123.0.6312.86). This can occur if either
1. you did not perform an installation before running the script (e.g. `npx puppeteer browsers install chrome`) or
2. your cache path is incorrectly configured (which is: /app/node_modules/.cache/puppeteer).
For (2), check out our guide on configuring puppeteer at https://pptr.dev/guides/configuration.

自建rsshub，Node Version: v22.14.0

docker pull diygod/rsshub:latest

部署命令是
docker run
--name rsshub
-d
一些需要cookies的令牌

官方的rsshub 报错

TargetCloseError: Waiting for selector `.pubCon` failed: Protocol error (Runtime.callFunctionOn): Target closed

[KwToPA]

看报错似乎是要Puppeteer，能否支持免Puppeteer 抓取？

[cscnk52]

You should use docker pull diygod/rsshub:chromium-bundled to enable puppeteer, the origin site is strict anti-crawling, puppeteer is required.

[KwToPA]

请问反扒严重是最近的测试结果吗?

因为该网站之前禁止境外IP，后来开放境外IP入站，所以猜测应该放宽了限制

[cscnk52]

Always, the data was loaded by script, not direct in HTML, puppeteer is required to execute script to crawl the data.

You can try by yourself；

curl -X GET 'http://www.customs.gov.cn/customs/302249/zfxxgk/2799825/2799883/index.html' -I

The remote return 412 error code, means it can't direct crawl by get, need browser to execute, it's not relevant to IP address.

[KwToPA]

curl -X GET 'http://www.customs.gov.cn/customs/302249/zfxxgk/2799825/2799883/index.html' -H 'User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/133.0.0.0 Safari/537.36' -I

加了UA测试还是不行

[cscnk52]

Yes，it's not issue about UA, it requires browser to execute JS code to get the data.

You only need to change your docker tag from latest to chromium-bundled.