You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: sources/academy/webscraping/scraping_basics_python/index.md
+11-13Lines changed: 11 additions & 13 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -18,9 +18,7 @@ This course is incomplete. As we work on adding new lessons, we would love to he
18
18
19
19
:::
20
20
21
-
## About this course
22
-
23
-
### What you'll learn
21
+
## What you'll learn
24
22
25
23
- Inspecting pages using browser DevTools
26
24
- Downloading web pages using the HTTPX library
@@ -29,11 +27,11 @@ This course is incomplete. As we work on adding new lessons, we would love to he
29
27
- Following links programatically (crawling)
30
28
- Saving time and effort with frameworks, such as Scrapy, and scraping platforms, such as Apify
31
29
32
-
###Who this course is for
30
+
## Who this course is for
33
31
34
32
Anyone with basic knowledge of developing programs in Python who wants to start with web scraping can take this course. The course does not expect you to have any prior knowledge of web technologies or scraping.
35
33
36
-
###Requirements
34
+
## Requirements
37
35
38
36
- macOS, Linux or Windows machine with a web browser and Python installed
@@ -44,25 +42,25 @@ Anyone with basic knowledge of developing programs in Python who wants to start
44
42
45
43
### Why learn scraping
46
44
47
-
The internet is full of useful data, but most of them isn't offered in a structured way, easy to process programatically. That's why you need scraping, a set of approaches how to download websites and extract data from them.
45
+
The internet is full of useful data, but most of it isn't offered in a structured way that is easy to process programmatically. That's why you need scraping, a set of approaches to download websites and extract data from them.
48
46
49
-
Scraper development is also a fun and challenging way to learn web development, web technologies, and understand the internet. You will reverse-engineer websites and understand how they work internally, what technologies they use and how they communicate with their servers. You will also master your chosen programming language and core programming concepts. Understanding web scraping gives you a head start in learning web technologies: HTML, CSS, JavaScript, frontend frameworks (such as React or Next.js), HTTP, REST APIs, GraphQL APIs, and more.
47
+
Scraper development is also a fun and challenging way to learn web development, web technologies, and understand the internet. You will reverse-engineer websites, understand how they work internally, discover what technologies they use, and learn how they communicate with their servers. You will also master your chosen programming language and core programming concepts. Understanding web scraping gives you a head start in learning web technologies such as HTML, CSS, JavaScript, frontend frameworks (like React or Next.js), HTTP, REST APIs, GraphQL APIs, and more.
50
48
51
49
### Why build your own scrapers
52
50
53
-
Point-and-click or no-code scraping solutions take you only so far. While simple to use, they're not flexible or optimized enough to deal with advanced cases. Those can be tackled only by scrapers - custom-built programs specializing on mining data from the internet. And unlike with ready-made solutions, you can always fine-tune your scraper programs to do more, less, or the same, but faster or cheaper.
51
+
Scrapers are programs specifically designed to mine data from the internet. Point-and-click or no-code scraping solutions do exist, but they only take you so far. While simple to use, they lack the flexibility and optimization needed to handle advanced cases. Only custom-built scrapers can tackle more difficult challenges. And unlike ready-made solutions, they can be fine-tuned to perform tasks more efficiently, at a lower cost, or with greater precision.
54
52
55
53
### Why become a scraper dev
56
54
57
-
As a scraper developer you are not limited by the fact if certain data is or isn't available programatically through an official API. The whole web is your API. What you can do with scraping?
55
+
As a scraper developer, you are not limited by whether certain data is available programmatically through an official API—the entire web becomes your API. Here are some things you can do if you understand scraping:
58
56
59
-
- Improve your productivity by building small tools, such as your own real estate or sneakers watchdog.
60
-
- Companies can hire you to build custom scrapers mining data important for their business.
61
-
- You can publish your scrapers to a platform, such as the [Apify Store](https://apify.com/store), and let others to pay you a rent for using them.
57
+
- Improve your productivity by building personal tools, such as your own real estate or rare sneakers watchdog.
58
+
- Companies can hire you to build custom scrapers to mine data important for their business.
59
+
- You can publish your scrapers on platforms like the [Apify Store](https://apify.com/store) and earn money by renting them out to others.
62
60
63
61
### Why learn with Apify
64
62
65
-
We are [Apify](https://apify.com), a web scraping and automation platform, but we built this course on top of open source technologies. The skills you will learn are applicable to any scraping project, and you'll be able to run your scrapers on any computer. We will show you how scraping platforms can simplify your life, but those lessons are optional and they're designed to fit into our [free tier](https://apify.com/pricing).
63
+
We are [Apify](https://apify.com), a web scraping and automation platform, but we built this course on top of open source technologies. The skills you will learn are applicable to any scraping project, and you'll be able to run your scrapers on any computer. We will show you how scraping platforms can simplify your life, but those lessons are optional and designed to fit within our [free tier](https://apify.com/pricing).
0 commit comments