Merge branch 'master' into percy-test

Author: mstephen19

content/academy/anti_scraping.md

@@ -73,7 +73,7 @@ Solely based on the way how the bots operate. It comperes data-rich pages visits
 
 By definition, this is not an anti-scraping method, but it can heavily affect the reliability of a scraper. If your target website drastically changes its CSS selectors, and your scraper is heavily reliant on selectors, it could break. In principle, websites using this method change their HTML structure or CSS selectors randomly and frequently, making the parsing of the data harder, and requiring more maintenance of the bot.
 
-One of the best ways of avoiding the possible breaking of your scraper due to website structure changes is to limit your reliance on data from HTML elements as much as possible (see [API Scraping]({{@link api_scraping.md}}) and [JavaScript objects within HTML]({{@link web_scraping_for_beginners/data_collection/js_in_html.md}}))
+One of the best ways of avoiding the possible breaking of your scraper due to website structure changes is to limit your reliance on data from HTML elements as much as possible (see [API Scraping]({{@link api_scraping.md}}) and [JavaScript objects within HTML]({{@link tutorials/js_in_html.md}}))
 
 ### IP session consistency
 
@@ -89,6 +89,6 @@ One of the most successful and advanced methods is collecting the browser's "fin
 
 > It's important to note that this method also blocks all users that cannot evaluate JavaScript (such as bots sending only static HTTP requests), and combines both of the fundamental methods mentioned earlier.
 
-## [](#next) Next up
+## [](#first) First up
 
 In our [first section]({{@link anti_scraping/techniques.md}}), we'll be discussing more in-depth about the various anti-scraping methods and techniques websites use, as well as how to mitigate these protections.

content/academy/api_scraping.md

@@ -94,6 +94,6 @@ const decoded = Buffer.from(value, 'base64').toString('utf-8')
 console.log(decoded)
 ```
 
-## [](#next) Next up
+## [](#first) First up
 
 Get started with this course by learning some general knowledge about API scraping in the [General API Scraping]({{@link api_scraping/general_api_scraping.md}}) section! This section will teach you everything you need to know about scraping APIs before moving into more complex sections.

content/academy/apify_platform.md

@@ -15,6 +15,6 @@ The [Apify platform](https://apify.com) was built to serve large-scale and high-
 
 In this course, you'll be learning how to become an Apify platform developer from the ground up. From creating your first account, to developing actors, this is your one-stop-shop for understanding how the platform works, and how to work with it.
 
-## [](#next) Next up
+## [](#first) First up
 
 We'll start off this course light, by showing you how to create an Apify account and get everything ready for development with the platform. [Let's go!]({{@link apify_platform/getting_started.md}})

content/academy/concepts.md

@@ -1,13 +1,13 @@
 ---
 title: Concepts
 description: Learn about some common yet tricky concepts and terms that are used frequently within the academy, as well as in the world of scraper development.
-menuWeight: 9
+menuWeight: 11
 category: glossary
 paths:
     - concepts
 ---
 
-# [](#concepts) Concepts
+# [](#concepts) Concepts 🤔
 
 There are some terms and concepts you'll see frequently repeated throughout various courses in the academy. Many of these concepts are common, and even fundamental in the scraping world, which makes it necessary to explain them to our course-takers; however it would be inconvenient for our readers to explain these terms each time they appear in a lesson.
 

content/academy/expert_scraping_with_apify.md

@@ -17,36 +17,16 @@ Before developing a pro-level Apify scraper, there are some important things you
 
 > If you've already gone through the [Web scraping for beginners course]({{@link web_scraping_for_beginners.md}}) and the first lessons of the [Apify platform course]({{@link apify_platform.md}}), you will be more than well equipped to continue on with the lessons in this course.
 
-### [](#javascript-and-node) JavaScript + Node.js
+<!-- ### [](#puppeteer-playwright) Puppeteer/Playwright
 
-It is recommended to understand at least the fundamentals of JavaScript and be proficient with Node.js prior to developing an actor on the Apify platform. If you are not yet comfortable with asynchronous programming (with promises and `async...await`), loops (and the different types of loops in JavaScript), modularity, or working with external packages, we would recommend studying the following resources before coming back and continuing this section:
-
-- [`async...await` (YouTube)](https://www.youtube.com/watch?v=vn3tm0quoqE&ab_channel=Fireship)
-- [JavaScript loops (MDN)](https://developer.mozilla.org/en-US/docs/Web/JavaScript/Guide/Loops_and_iteration)
-- [Modularity in Node.js](https://www.section.io/engineering-education/how-to-use-modular-patterns-in-nodejs/)
-
-### [](#general-web-development) General web development
-
-Throughout the next lessons, we will sometimes use certain technologies and terms related to the web without explaining them. This is because the knowledge of them will be **assumed** (unless we're showing something out of the ordinary).
-
-- [HTML](https://developer.mozilla.org/en-US/docs/Web/HTML)
-- [HTTP protocol](https://developer.mozilla.org/en-US/docs/Web/HTTP)
-- [DevTools]({{@link web_scraping_for_beginners/data_collection/browser_devtools.md}})
+[Puppeteer](https://pptr.dev/) is a library for running and controlling a [headless browser]({{@link web_scraping_for_beginners/crawling/headless_browser.md}}) in Node.js, and was developed at Google. The team working on it was hired by Microsoft to work on the [Playwright](https://playwright.dev/) project; therefore, many parallels can be seen between both the `puppeteer` and `playwright` packages. Proficiency in at least one of these will be good enough. -->
 
 ### [](#crawlee-apify-sdk-and-cli) Crawlee, Apify SDK, and the Apify CLI
 
 If you're feeling ambitious, you don't need to have any prior experience with Crawlee to get started with this course; however, at least 5-10 minutes of exposure is recommended. If you haven't yet tried out Crawlee, you can refer to [this lesson]({{@link web_scraping_for_beginners/crawling/pro_scraping.md}}) in the **Web scraping for beginners** course (and ideally follow along). To familiarize with the Apify SDK,you can refer to the [Apify Platform]({{@link apify_platform.md}}) course.
 
 The Apify CLI will play a core role in the running and testing of the actor you will build, so if you haven't gotten it installed already, please refer to [this short lesson]({{@link tools/apify_cli.md}}).
 
-### [](#puppeteer-playwright) Puppeteer/Playwright
-
-[Puppeteer](https://pptr.dev/) is a library for running and controlling a [headless browser]({{@link web_scraping_for_beginners/crawling/headless_browser.md}}) in Node.js, and was developed at Google. The team working on it was hired by Microsoft to work on the [Playwright](https://playwright.dev/) project; therefore, many parallels can be seen between both the `puppeteer` and `playwright` packages. Proficiency in at least one of these will be good enough.
-
-### [](#jquery-or-cheerio) jQuery or Cheerio
-
-We'll be using the [`cheerio`](https://www.npmjs.com/package/cheerio) package a whole lot to parse data from HTML. This package provides a simple API using jQuery syntax to help traverse downloaded HTML within Node.js.
-
 ### [](#git) Git
 
 In one of the later lessons, we'll be learning how to integrate our actor on the Apify platform with a Github repository. For this, you'll need to understand at least the basics of [Git](https://git-scm.com/docs). Here's a [great tutorial](https://product.hubspot.com/blog/git-and-github-tutorial-for-beginners) to help you get started with Git.
@@ -57,10 +37,10 @@ Docker is a massive topic on its own, but don't be worried! We only expect you t
 
 ### [](#actor-basics) The basics of actors
 
-Part of this course will be learning more in-depth about actors; however, some basic knowledge is already assumed. If you haven't yet read the [actors]({{@link apify_platform/getting_started/actors.md}}) lesson of the **Apify platform** course, it's highly recommended to give it a glance before moving forward.
+Part of this course will be learning more in-depth about actors; however, some basic knowledge is already assumed. If you haven't yet gone through the [actors]({{@link apify_platform/getting_started/actors.md}}) lesson of the **Apify platform** course, it's highly recommended to at least give it a glance before moving forward.
 
-## [](#next) Next up
+## [](#first) First up
 
-[Next up]({{@link expert_scraping_with_apify/crawlee.md}}), we'll be learning in-depth about the most important tool in your actor-development toolbelt: The **Crawlee**.
+[First up]({{@link expert_scraping_with_apify/actors_webhooks.md}}), we'll be learning in-depth about integrating actors with each other using webhooks.
 
 > Each lesson will have a short _(and optional)_ quiz that you can take at home to test your skills and knowledge related to the lesson's content. Some questions have straight factual answers, but some others can have varying opinionated answers.

content/academy/expert_scraping_with_apify/actors_webhooks.md

@@ -1,7 +1,7 @@
 ---
-title: II - Webhooks & advanced actor overview
+title: I - Webhooks & advanced actor overview
 description: Learn more advanced details about actors, how they work, and the default configurations they can take. Also learn how to integrate your actor with webhooks.
-menuWeight: 6.2
+menuWeight: 6.1
 paths:
     - expert-scraping-with-apify/actors-webhooks
 ---
@@ -12,7 +12,9 @@ Thus far, you've run actors on the platform and written an actor of your own, wh
 
 ## [](#advanced-actors) Advanced actor overview
 
-Take another look at the files within your project from the previous lesson. You'll notice that there is a **Dockerfile**. Every single actor has a Dockerfile (the actor's **Image**) which tells Docker how to spin up a container on the Apify platform which can successfully run the actor's code. "Apify Actors" is basically just a serverless platform that is running multiple Docker containers. For a deeper understanding of actor Dockerfiles, refer to the [Apify actor Dockerfile docs](https://sdk.apify.com/docs/guides/docker-images#example-dockerfile).
+In this course, we'll be working out of the Amazon scraper project from the **Web scraping for beginners** course. If you haven't already built that project, you can do it in three short lessons [here]({{@link web_scraping_for_beginners/challenge.md}}). We've made a few small modifications to the project with the Apify SDK, but 99% of the code is still the same.
+
+Take another look at the files within your Amazon scraper project. You'll notice that there is a **Dockerfile**. Every single actor has a Dockerfile (the actor's **Image**) which tells Docker how to spin up a container on the Apify platform which can successfully run the actor's code. "Apify Actors" is basically just a serverless platform that is running multiple Docker containers. For a deeper understanding of actor Dockerfiles, refer to the [Apify actor Dockerfile docs](https://sdk.apify.com/docs/guides/docker-images#example-dockerfile).
 
 ## [](#webhooks) Webhooks
 

content/academy/expert_scraping_with_apify/apify_api_and_client.md

@@ -1,7 +1,7 @@
 ---
-title: V - Apify API & client
+title: IV - Apify API & client
 description: Gain an in-depth understanding of the two main ways of programmatically interacting with the Apify platform - through the API, and through a client.
-menuWeight: 6.5
+menuWeight: 6.4
 paths:
     - expert-scraping-with-apify/apify-api-and-client
 ---

content/academy/expert_scraping_with_apify/bypassing_anti_scraping.md

@@ -1,7 +1,7 @@
 ---
-title: VII - Bypassing anti-scraping methods
+title: VI - Bypassing anti-scraping methods
 description: Learn about bypassing anti-bot methods with proxies and proxy/session rotation. Use Crawlee and the Apify SDK to abstract away the overheads that come with these concepts.
-menuWeight: 6.7
+menuWeight: 6.6
 paths:
     - expert-scraping-with-apify/bypassing-anti-scraping
 ---

content/academy/expert_scraping_with_apify/crawlee.md

@@ -1,7 +1,7 @@
 ---
-title: III - Managing source code
+title: II - Managing source code
 description: Learn how to manage your actor's source code more efficiently by integrating it with a Github repository. This is the standard on the Apify platform.
-menuWeight: 6.3
+menuWeight: 6.2
 paths:
     - expert-scraping-with-apify/managing-source-code
 ---