Currently, Crawlee is quite heavy on the startup time, and this also propagates to the Apify SDK. On Apify platform, the import times are between about 500ms (@crawlee/http) up to 1000ms (full crawlee). Bundling with @vercel/ncc reduces that time by about 30%.
While Docker start times on Apify have continuously improved and are often below 1 second, the import times became major obstacle for faster startup. Plain Node.js startup is around 25ms, so there is a lot of space for improvement.
I haven't yet done enough research to propose some good solutions.
Currently, Crawlee is quite heavy on the startup time, and this also propagates to the Apify SDK. On Apify platform, the import times are between about 500ms (
@crawlee/http) up to 1000ms (fullcrawlee). Bundling with@vercel/nccreduces that time by about 30%.While Docker start times on Apify have continuously improved and are often below 1 second, the import times became major obstacle for faster startup. Plain Node.js startup is around 25ms, so there is a lot of space for improvement.
I haven't yet done enough research to propose some good solutions.