-
Notifications
You must be signed in to change notification settings - Fork 187
Expand file tree
/
Copy pathserp.json
More file actions
272 lines (272 loc) · 12 KB
/
serp.json
File metadata and controls
272 lines (272 loc) · 12 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
[
{
"position": 1,
"title": "Scrapfly Blog - Web Scraping News and Tutorials",
"url": "https://scrapfly.io/blog/",
"origin": "Scrapfly",
"domain": "scrapfly.io",
"description": "Insider knowledge on web scraping, web automation, data extraction and more. Learn how to scrape websites, avoid blocks, use proxies and APIs, and much ...",
"date": null
},
{
"position": 2,
"title": "Everything to Know to Start Web Scraping in Python Today",
"url": "https://scrapfly.io/blog/posts/everything-to-know-about-web-scraping-python",
"origin": "Scrapfly",
"domain": "scrapfly.io",
"description": "Scrapfly Cloud Browsers. Scrapfly's Web Scraping API can manage a fleet of cloud headless browsers for you and simplify the entire browser ...",
"date": "Jul 2, 2025"
},
{
"position": 3,
"title": "Web Scraping Services Explained",
"url": "https://scrapfly.io/blog/posts/web-scraping-services-explained",
"origin": "Scrapfly",
"domain": "scrapfly.io",
"description": "Complete guide to web scraping services covering managed APIs, self-hosted platforms, pricing models, and best practices for data ...",
"date": "Sep 16, 2025"
},
{
"position": 4,
"title": "Web Scraping with Python",
"url": "https://scrapfly.io/blog/posts/web-scraping-with-python",
"origin": "Scrapfly",
"domain": "scrapfly.io",
"description": "Web scraping with Python is surprisingly accessible though scaling up web scraping operations can be difficult and this is where Scrapfly can ...",
"date": "Aug 22, 2024"
},
{
"position": 5,
"title": "Complete Guide to Web Scraping using Typescript",
"url": "https://scrapfly.io/blog/posts/ultimate-intro-to-web-scraping-with-typescript",
"origin": "Scrapfly",
"domain": "scrapfly.io",
"description": "Scrapfly is a powerful web scraping API that integrates directly with Typescript web scrapers using Typescript SDK. ... ScrapFly provides web ...",
"date": "Aug 22, 2024"
},
{
"position": 6,
"title": "How to Scrape Without Getting Blocked? In-Depth Tutorial",
"url": "https://medium.com/@scrapfly/how-to-scrape-without-getting-blocked-in-depth-tutorial-5cc32a3e13c5",
"origin": "Medium · Scrapfly",
"domain": "medium.com",
"description": "abstracting away logic that deals with web scraping blocking results in much ...",
"date": null
},
{
"position": 7,
"title": "Web Scraping Speed: Processes, Threads and Async",
"url": "https://scrapfly.io/blog/posts/web-scraping-speed",
"origin": "Scrapfly",
"domain": "scrapfly.io",
"description": "... web server responds: response = requests.get(\"https://scrapfly.io/blog/\") print(f\"requests finished in: {time()-_start:.2f}\"). We also ...",
"date": "Aug 22, 2024"
},
{
"position": 8,
"title": "Introducing Scrapfly Typescript Web Scraping SDK - Medium",
"url": "https://scrapfly.medium.com/introducing-scrapfly-typescript-web-scraping-sdk-cb55967ee516?source=rss-------1",
"origin": "Medium · Scrapfly",
"domain": "scrapfly.medium.com",
"description": "Scrapfly is a language-agnostic HTTP API for web scraping now it's much easier to use with Typescript as it's just one npm install a way.",
"date": null
},
{
"position": 9,
"title": "Intro to Web Scraping using ScrapFly SDK and Python",
"url": "https://www.youtube.com/watch?v=y7FbFJ4jOW8",
"origin": "YouTube · Scrapfly",
"domain": "youtube.com",
"description": null,
"date": null
},
{
"position": 10,
"title": "Web Scraping Use Cases and Types",
"url": "https://scrapfly.io/use-case/web-scraping",
"origin": "Scrapfly",
"domain": "scrapfly.io",
"description": "Web scraped data powers thousands of companies and hundreds of different markets. Here's a quick summary from what we've learned by being in the web scraping ...",
"date": null
},
{
"position": 11,
"title": "Blog",
"url": "https://webscraper.io/blog",
"origin": "Web Scraper",
"domain": "webscraper.io",
"description": "We're thrilled to introduce the latest and greatest version of Web Scraper. Take your experience to a new level with the newly updated Link Selector and more.Missing: scrapgly | Show results with: scrapgly",
"date": "Aug 8, 2025"
},
{
"position": 12,
"title": "Python Web Scraping: Full Tutorial With Examples (2025)",
"url": "https://www.scrapingbee.com/blog/web-scraping-101-with-python/",
"origin": "ScrapingBee",
"domain": "scrapingbee.com",
"description": "Learn about web scraping in Python with this step-by-step tutorial. We will cover almost all of the tools Python offers to scrape the web.Missing: scrapgly | Show results with: scrapgly",
"date": "Jul 22, 2025"
},
{
"position": 13,
"title": "What is web scraping?",
"url": "https://blog.apify.com/what-is-web-scraping/",
"origin": "Apify Blog",
"domain": "blog.apify.com",
"description": "Web scraping is the process of automatically extracting data from a website. You use a program called a web scraper to access a web page, ...Missing: scrapgly | Show results with: scrapgly",
"date": "Oct 15, 2024"
},
{
"position": 14,
"title": "A Practical Introduction to Web Scraping in Python",
"url": "https://realpython.com/python-web-scraping-practical-introduction/",
"origin": "Real Python",
"domain": "realpython.com",
"description": "This tutorial guides you through extracting data from websites using string methods, regular expressions, and HTML parsers.Missing: scrapgly | Show results with: scrapgly",
"date": "Dec 21, 2024"
},
{
"position": 15,
"title": "My first blog post on using automated web scraping",
"url": "https://club.ministryoftesting.com/t/my-first-blog-post-on-using-automated-web-scraping/75774",
"origin": "Ministry of Testing - The Club",
"domain": "club.ministryoftesting.com",
"description": "Here's the first post I've made on how I learned how to create web scrapers in Python and Selenium and how I got them to just work. I have more ...Missing: scrapgly | Show results with: scrapgly",
"date": "Apr 11, 2024"
},
{
"position": 16,
"title": "What is Web Scraping? The Ultimate Beginner Guide",
"url": "https://www.nimbleway.com/blog/what-is-web-scraping",
"origin": "Nimble Way",
"domain": "nimbleway.com",
"description": "Web scraping is a technique that automates the process of collecting data from websites. Unlike manually copying and pasting information.",
"date": "Oct 15, 2023"
},
{
"position": 17,
"title": "Web Scraping in R: The Complete Guide 2025",
"url": "https://www.zenrows.com/blog/web-scraping-r",
"origin": "ZenRows",
"domain": "zenrows.com",
"description": "In this step-by-step tutorial, you'll learn how to scrape websites in R using libraries like rvest and RSelenium.",
"date": "Feb 18, 2025"
},
{
"position": 18,
"title": "How to scrape data from a website (JavaScript vs low-code)",
"url": "https://blog.n8n.io/how-to-scrape-data-from-a-website/",
"origin": "n8n Blog",
"domain": "blog.n8n.io",
"description": "What is web scraping? Web scraping (also called web harvesting) is the process of automatically extracting and collecting data from a website.",
"date": "May 31, 2023"
},
{
"position": 19,
"title": "Scrape Blogs Posts Fast with a Web Scraper",
"url": "https://www.octoparse.com/blog/build-your-blog-fast-with-web-scraping",
"origin": "Octoparse",
"domain": "octoparse.com",
"description": "You can build a web scraper to scrape blog posts fast and easy. With the content database, you can sort through a large amount of content ...",
"date": "Jan 22, 2021"
},
{
"position": 20,
"title": "Scrapingdog: Best Web Scraping API",
"url": "https://www.scrapingdog.com/",
"origin": "Scrapingdog",
"domain": "scrapingdog.com",
"description": "Scrapingdog is your all-in-one Web Scraping API, effortlessly managing proxies and headless browsers, allowing you to extract the data you need with ease.",
"date": null
},
{
"position": 21,
"title": "The Web Scraping Problem: Part 1",
"url": "https://www.akamai.com/blog/security/the-web-scraping-problem-part-1",
"origin": "Akamai",
"domain": "akamai.com",
"description": "In this three-part blog series, we'll quantify the bot traffic on the internet, then discuss the different aspects of web scraping and how they affect various ...",
"date": "Jan 30, 2024"
},
{
"position": 22,
"title": "Web Scraping with Javascript and Nodejs (2025 Guide)",
"url": "https://serpapi.com/blog/web-scraping-in-javascript-complete-tutorial-for-beginner/",
"origin": "SerpApi",
"domain": "serpapi.com",
"description": "How to scrape data from a website with Javascript? A complete step-by-step tutorial for beginners. Using Cheerios, Axios, and Puppeteer.",
"date": "Oct 25, 2023"
},
{
"position": 23,
"title": "Web Scraping & Custom Extraction",
"url": "https://www.screamingfrog.co.uk/seo-spider/tutorials/web-scraping/",
"origin": "Screaming Frog",
"domain": "screamingfrog.co.uk",
"description": "This tutorial walks you through how you can use the Screaming Frog SEO Spider's custom extraction feature, to scrape data from websites.",
"date": null
},
{
"position": 24,
"title": "What Is Web Scraping? Definitive Guide 2025",
"url": "https://brightdata.com/blog/how-tos/what-is-web-scraping",
"origin": "Bright Data",
"domain": "brightdata.com",
"description": "Web scraping refers to the process of extracting data from websites. Once collected, this information is generally exported to more useful formats, such as CSV ...Missing: scrapgly | Show results with: scrapgly",
"date": null
},
{
"position": 25,
"title": "Comprehensive Guide to Web Scraping in Python for 2025",
"url": "https://crawlbase.com/blog/web-scraping-the-comprehensive-guide/",
"origin": "Crawlbase",
"domain": "crawlbase.com",
"description": "The purpose of this guide is to help introduce web scraping for beginners and explore how to find all URLs on a website. What is Web Scraping?",
"date": "Mar 23, 2025"
},
{
"position": 26,
"title": "The Best Scraping Blogs and Websites",
"url": "https://feedly.com/i/top/scraping-blogs",
"origin": "Feedly",
"domain": "feedly.com",
"description": "Fully managed enterprise-grade web scraping service provider based in the USA. We take care of web crawling, data extraction, automated quality checks and ...",
"date": null
},
{
"position": 27,
"title": "15 Best Web Scraping Tools In 2025 (Pros, Cons, Pricing)",
"url": "https://www.scraperapi.com/web-scraping/tools/",
"origin": "ScraperAPI",
"domain": "scraperapi.com",
"description": "Discover the top 15 web scraping tools for 2025. Compare features, pricing, and pros/cons to find the perfect tool for your needs.",
"date": null
},
{
"position": 28,
"title": "What Is Web Scraping? How To Legally Extract Web Content",
"url": "https://kinsta.com/knowledgebase/what-is-web-scraping/",
"origin": "Kinsta",
"domain": "kinsta.com",
"description": "Web scraping refers to the process of extracting content and data from websites using software. For example, most price comparison services use ...",
"date": "Apr 22, 2024"
},
{
"position": 29,
"title": "Scrape Any Website in 5 Minutes! Web Scraping Tutorial",
"url": "https://www.youtube.com/watch?v=5U4OVXDw1Zo",
"origin": "YouTube · Kunal Kushwaha",
"domain": "youtube.com",
"description": null,
"date": null
},
{
"position": 30,
"title": "ScrapingBee's Blog",
"url": "https://www.scrapingbee.com/blog/",
"origin": "ScrapingBee",
"domain": "scrapingbee.com",
"description": "The ScrapingBee Blog. We help you get better at web-scraping: detailed tutorials, case studies and writings by industry experts.Missing: scrapgly | Show results with: scrapgly",
"date": null
}
]