docs: website design uplift (#2872)

Deployed here: https://webrdaniel.github.io/:
It is not possible to navigate to the updated `/python` page as it lives
in different repo.

Changes:
- navigation header (different on index page and javascript pages)
- footer
- search modal
- new index page
- new [/js](https://webrdaniel.github.io/js) page

Figma design files are
[here](https://www.figma.com/design/EK51g98Cjx8UzmKJOUMcVe/Crawlee-brand-exploration?node-id=768-26162&t=tARb0KC2maZWdIaZ-0)

Content file:
https://www.notion.so/apify/Crawlee-homepage-value-props-12af39950a2280d29d20edb080b2ece9?pvs=4

---------

Co-authored-by: Eva Baldasseroni <37815707+baldasseva@users.noreply.github.com>
Co-authored-by: katzino <katzino@gmail.com>
Co-authored-by: Martin Adámek <banan23@gmail.com>
Co-authored-by: Jindřich Bär <jindrichbar@gmail.com>

Author: 5 people

CHANGELOG.md

@@ -1256,7 +1256,7 @@ const crawler = new BasicCrawler({
 
 #### How to use `sendRequest()`?
 
-See [the Got Scraping guide](https://crawlee.dev/docs/guides/got-scraping).
+See [the Got Scraping guide](https://crawlee.dev/js/docs/guides/got-scraping).
 
 #### Removed options
 
@@ -1381,7 +1381,7 @@ Previously, you were able to have a browser pool that would mix Puppeteer and Pl
 
 One small feature worth mentioning is the ability to handle requests with browser crawlers outside the browser. To do that, we can use a combination of `Request.skipNavigation` and `context.sendRequest()`.
 
-Take a look at how to achieve this by checking out the [Skipping navigation for certain requests](https://crawlee.dev/docs/examples/skip-navigation) example!
+Take a look at how to achieve this by checking out the [Skipping navigation for certain requests](https://crawlee.dev/js/docs/examples/skip-navigation) example!
 
 ### Logging
 
@@ -1441,14 +1441,14 @@ await Actor.main(async () => {
 
 #### Events
 
-Apify SDK (v2) exports `Apify.events`, which is an `EventEmitter` instance. With Crawlee, the events are managed by [`EventManager`](https://crawlee.dev/api/core/class/EventManager) class instead. We can either access it via `Actor.eventManager` getter, or use `Actor.on` and `Actor.off` shortcuts instead.
+Apify SDK (v2) exports `Apify.events`, which is an `EventEmitter` instance. With Crawlee, the events are managed by [`EventManager`](https://crawlee.dev/js/api/core/class/EventManager) class instead. We can either access it via `Actor.eventManager` getter, or use `Actor.on` and `Actor.off` shortcuts instead.
 
 ```diff
 -Apify.events.on(...);
 +Actor.on(...);
 ```
 
-> We can also get the [`EventManager`](https://crawlee.dev/api/core/class/EventManager) instance via `Configuration.getEventManager()`.
+> We can also get the [`EventManager`](https://crawlee.dev/js/api/core/class/EventManager) instance via `Configuration.getEventManager()`.
 
 In addition to the existing events, we now have an `exit` event fired when calling `Actor.exit()` (which is called at the end of `Actor.main()`). This event allows you to gracefully shut down any resources when `Actor.exit` is called.
 

MIGRATIONS.md

@@ -1,5 +1,5 @@
 # Migration from 2.x.x to 3.0.0
-Check the v3 [upgrading guide](https://crawlee.dev/docs/upgrading/upgrading-to-v3).
+Check the v3 [upgrading guide](https://crawlee.dev/js/docs/upgrading/upgrading-to-v3).
 
 # Migration from 1.x.x to 2.0.0
 There should be no changes needed apart from upgrading your Node.js version to >= 15.10. If you encounter issues with `cheerio`, [read their CHANGELOG](https://github.com/cheeriojs/cheerio/releases). We bumped it from `rc.3` to `rc.10`.

README.md

@@ -28,7 +28,7 @@ Crawlee is available as the [`crawlee`](https://www.npmjs.com/package/crawlee) N
 
 ## Installation
 
-We recommend visiting the [Introduction tutorial](https://crawlee.dev/docs/introduction) in Crawlee documentation for more information.
+We recommend visiting the [Introduction tutorial](https://crawlee.dev/js/docs/introduction) in Crawlee documentation for more information.
 
 > Crawlee requires **Node.js 16 or higher**.
 
@@ -78,7 +78,7 @@ const crawler = new PlaywrightCrawler({
 await crawler.run(['https://crawlee.dev']);
 ```
 
-By default, Crawlee stores data to `./storage` in the current working directory. You can override this directory via Crawlee configuration. For details, see [Configuration guide](https://crawlee.dev/docs/guides/configuration), [Request storage](https://crawlee.dev/docs/guides/request-storage) and [Result storage](https://crawlee.dev/docs/guides/result-storage).
+By default, Crawlee stores data to `./storage` in the current working directory. You can override this directory via Crawlee configuration. For details, see [Configuration guide](https://crawlee.dev/js/docs/guides/configuration), [Request storage](https://crawlee.dev/js/docs/guides/request-storage) and [Result storage](https://crawlee.dev/js/docs/guides/result-storage).
 
 ### Installing pre-release versions
 

docs/examples/cheerio_crawler.ts

@@ -25,7 +25,7 @@ const crawler = new CheerioCrawler({
 
     // This function will be called for each URL to crawl.
     // It accepts a single parameter, which is an object with options as:
-    // https://crawlee.dev/api/cheerio-crawler/interface/CheerioCrawlerOptions#requestHandler
+    // https://crawlee.dev/js/api/cheerio-crawler/interface/CheerioCrawlerOptions#requestHandler
     // We use for demonstration only 2 of them:
     // - request: an instance of the Request class with information such as the URL that is being crawled and HTTP method
     // - $: the cheerio object containing parsed HTML

docs/examples/http_crawler.ts

@@ -25,7 +25,7 @@ const crawler = new HttpCrawler({
 
     // This function will be called for each URL to crawl.
     // It accepts a single parameter, which is an object with options as:
-    // https://crawlee.dev/api/http-crawler/interface/HttpCrawlerOptions#requestHandler
+    // https://crawlee.dev/js/api/http-crawler/interface/HttpCrawlerOptions#requestHandler
     // We use for demonstration only 2 of them:
     // - request: an instance of the Request class with information such as the URL that is being crawled and HTTP method
     // - body: the HTML code of the current page

docs/examples/jsdom_crawler.ts

@@ -25,7 +25,7 @@ const crawler = new JSDOMCrawler({
 
     // This function will be called for each URL to crawl.
     // It accepts a single parameter, which is an object with options as:
-    // https://crawlee.dev/api/jsdom-crawler/interface/JSDOMCrawlerOptions#requestHandler
+    // https://crawlee.dev/js/api/jsdom-crawler/interface/JSDOMCrawlerOptions#requestHandler
     // We use for demonstration only 2 of them:
     // - request: an instance of the Request class with information such as the URL that is being crawled and HTTP method
     // - window: the JSDOM window object

docs/experiments/request_locking.mdx

@@ -82,8 +82,8 @@ import { RequestQueueV2 } from 'crawlee';
 const queue = await RequestQueueV2.open('my-locking-queue');
 await queue.addRequests([
     { url: 'https://crawlee.dev' },
-    { url: 'https://crawlee.dev/docs' },
-    { url: 'https://crawlee.dev/api' },
+    { url: 'https://crawlee.dev/js/docs' },
+    { url: 'https://crawlee.dev/js/api' },
 ]);
 ```
 

docs/guides/docker_browser_js.txt

@@ -1,5 +1,5 @@
 # Specify the base Docker image. You can read more about
-# the available images at https://crawlee.dev/docs/guides/docker-images
+# the available images at https://crawlee.dev/js/docs/guides/docker-images
 # You can also use any other image from Docker Hub.
 FROM apify/actor-node-playwright-chrome:20
 

docs/guides/docker_browser_ts.txt

@@ -1,5 +1,5 @@
 # Specify the base Docker image. You can read more about
-# the available images at https://crawlee.dev/docs/guides/docker-images
+# the available images at https://crawlee.dev/js/docs/guides/docker-images
 # You can also use any other image from Docker Hub.
 FROM apify/actor-node-playwright-chrome:20 AS builder
 

docs/guides/docker_node_js.txt

@@ -1,5 +1,5 @@
 # Specify the base Docker image. You can read more about
-# the available images at https://crawlee.dev/docs/guides/docker-images
+# the available images at https://crawlee.dev/js/docs/guides/docker-images
 # You can also use any other image from Docker Hub.
 FROM apify/actor-node:20