Skip to content

Commit 23cfffc

Browse files
mazen-rmazen-r
authored
Merge pull request #58 from scrapfly/fix-bing
Update country configuration to GB and update data
2 parents 8ec38d0 + c0fb83c commit 23cfffc

File tree

4 files changed

+167
-328
lines changed

4 files changed

+167
-328
lines changed

‎bing-scraper/bing.py‎

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,8 +17,12 @@
1717
# bypass Bing web scraping blocking
1818
"asp": True,
1919
# set the poxy location to US to get the result in English
20-
"country": "US",
20+
"country": "GB",
2121
"proxy_pool": "public_residential_pool",
22+
"debug":True,
23+
"os":"linux",
24+
"auto_scroll":True,
25+
2226
}
2327

2428

‎bing-scraper/results/keywords.json‎

Lines changed: 48 additions & 32 deletions
Original file line numberDiff line numberDiff line change
@@ -2,55 +2,71 @@
22
"FAQs": [
33
{
44
"query": "How to scrape emails from a website?",
5-
"answer": "Next, you will need a web scraper that can scrape emails from any website. For this example, we will download and install ParseHub, a free and powerful web scraper that works with any website. Now it’s time to get scraping. Open ParseHub and click on “New Project”. Then enter the URL of the page you will want to scrape.",
5+
"answer": "We will have to set up our scraper to click on each profile and extract their email. Next, you will need a web scraper that can scrape emails from any website. For this example, we will download and install ParseHub, a free and powerful web scraper that works with any website. Now it’s time to get scraping. Open ParseHub and click on “New Project”.",
66
"title": "How to Scrape Emails from any Website | ParseHub",
7-
"domain": "parsehub.com",
8-
"url": "https://www.parsehub.com/blog/scrape-emails/"
7+
"domain": "bing.com",
8+
"url": "https://www.bing.com/ck/a?!&&p=41cadb349b48845d81946a4548ede103e848c4600607f191c287af779dcfe29dJmltdHM9MTc1NzI4OTYwMA&ptn=3&ver=2&hsh=4&fclid=1ecd1879-483a-6ddd-344b-0e1849f86cee&u=a1aHR0cHM6Ly93d3cucGFyc2VodWIuY29tL2Jsb2cvc2NyYXBlLWVtYWlscy8&ntb=1"
99
},
1010
{
11-
"query": "How to scrape email addresses?",
12-
"answer": "Define a list of websites from which you want to scrape email addresses. This can be done manually or by using bots, chrome extensions, or any other scraping tool. Use a web scraping tool to crawl the websites in your list. The tool will extract the email addresses from the websites. Save the email addresses to a database or a file.",
13-
"title": "Email Scraping: Use Cases & Best Practices - HasData",
14-
"domain": "hasdata.com",
15-
"url": "https://hasdata.com/blog/email-scraping"
11+
"query": "How does email scraping work?",
12+
"answer": "The key is that scraping tools — or email scrapers — are built to ",
13+
"title": "How to Scrape Emails for Marketing (+ 6 Top Tools in 2025)",
14+
"domain": "bing.com",
15+
"url": "https://www.bing.com/ck/a?!&&p=8757a5f5e1a0f4c8e2b87e05d94f4add67393122202cac7d08398b06eaf90256JmltdHM9MTc1NzI4OTYwMA&ptn=3&ver=2&hsh=4&fclid=1ecd1879-483a-6ddd-344b-0e1849f86cee&u=a1aHR0cHM6Ly93d3cubGluZHkuYWkvYmxvZy9zY3JhcGluZy1lbWFpbHM&ntb=1"
1616
},
1717
{
18-
"query": "What is email scraping?",
19-
"answer": "Email scraping, or email harvesting, refers to the ",
20-
"title": "Email scraping: How-to & top email scraping tools in 2025 - AIMultiple",
21-
"domain": "research.aimultiple.com",
22-
"url": "https://research.aimultiple.com/email-scraping/"
18+
"query": "What happens if you scrape emails?",
19+
"answer": "Technical: Bad scraping can ",
20+
"title": "How to Scrape Emails for Marketing (+ 6 Top Tools in 2025)",
21+
"domain": "bing.com",
22+
"url": "https://www.bing.com/ck/a?!&&p=8757a5f5e1a0f4c8e2b87e05d94f4add67393122202cac7d08398b06eaf90256JmltdHM9MTc1NzI4OTYwMA&ptn=3&ver=2&hsh=4&fclid=1ecd1879-483a-6ddd-344b-0e1849f86cee&u=a1aHR0cHM6Ly93d3cubGluZHkuYWkvYmxvZy9zY3JhcGluZy1lbWFpbHM&ntb=1"
2323
},
2424
{
2525
"query": "Should you use a web scraper for email marketing?",
2626
"answer": "With the help of a free web scraper and by carefully selecting your lead sources, you can quickly build a high-quality email list. You can then use this list for email marketing efforts or use it as a custom audience in Google or Facebook Ads. Also, many companies web scrape email lists for their prospecting or cold email outreach.",
2727
"title": "How to Scrape Emails from any Website | ParseHub",
28-
"domain": "parsehub.com",
29-
"url": "https://www.parsehub.com/blog/scrape-emails/"
28+
"domain": "bing.com",
29+
"url": "https://www.bing.com/ck/a?!&&p=41cadb349b48845d81946a4548ede103e848c4600607f191c287af779dcfe29dJmltdHM9MTc1NzI4OTYwMA&ptn=3&ver=2&hsh=4&fclid=1ecd1879-483a-6ddd-344b-0e1849f86cee&u=a1aHR0cHM6Ly93d3cucGFyc2VodWIuY29tL2Jsb2cvc2NyYXBlLWVtYWlscy8&ntb=1"
3030
},
3131
{
32-
"query": "How do I use web scrape to expand my email list?",
33-
"answer": " will collect the selected data, and you'll receive an email notification. ➡️ Download the scrape as an Excel spreadsheet or JSON file. To sum up, incorporating web scraping into your toolkit for expanding email lists can significantly boost your outreach capabilities.",
34-
"title": "How to Scrape Emails from Websites: A Practical Guideline",
35-
"domain": "webscraping.blog",
36-
"url": "https://webscraping.blog/how-to-scrape-emails-from-website/"
32+
"query": "What is the best tool for scraping email addresses?",
33+
"answer": "This saves all the unique scraped email addresses to a CSV file named \"scraped_emails.csv\". While ",
34+
"title": "How to Scrape Emails from Any Website in 2025: The Ultimate Guide",
35+
"domain": "bing.com",
36+
"url": "https://www.bing.com/ck/a?!&&p=b81d9e6a78395567b82499d19db64ba9600724423404794bfa655b0ddefe6ef9JmltdHM9MTc1NzI4OTYwMA&ptn=3&ver=2&hsh=4&fclid=1ecd1879-483a-6ddd-344b-0e1849f86cee&u=a1aHR0cHM6Ly93d3cubWFya2V0aW5nc2Nvb3AuY29tL3RlY2gvd2ViLXNjcmFwaW5nL2hvdy10by1zY3JhcGUtZW1haWxzLWZyb20tYW55LXdlYnNpdGUtZm9yLXNhbGVzLXByb3NwZWN0aW5nLw&ntb=1"
3737
},
3838
{
39-
"query": "What tools do you use to scrape a website?",
40-
"answer": "Scrapy is suitable for large-scale data scraping tasks. ",
41-
"title": "Email scraping: How-to & top email scraping tools in 2025 - AIMultiple",
42-
"domain": "research.aimultiple.com",
43-
"url": "https://research.aimultiple.com/email-scraping/"
39+
"query": "How to scrape emails from Google Maps?",
40+
"answer": "If that’s not enough, we wrote a separate guide on scraping emails from Google Maps. To run the scraper, enter your HasData API key and either a list of websites or keywords, depending on the method you choose. Then, run the scraper: When it’s done, you can copy the data table (or part of it) or download the data as JSON or CSV.",
41+
"title": "Scrape Emails from Any Websites: From Python to AI Tools",
42+
"domain": "bing.com",
43+
"url": "https://www.bing.com/ck/a?!&&p=834f7d6add2db48cca6a6ef4bb289361a9bb65158afb1ef5f0db1296039c7d73JmltdHM9MTc1NzI4OTYwMA&ptn=3&ver=2&hsh=4&fclid=1ecd1879-483a-6ddd-344b-0e1849f86cee&u=a1aHR0cHM6Ly9oYXNkYXRhLmNvbS9ibG9nL2VtYWlsLXNjcmFwaW5n&ntb=1"
4444
}
4545
],
4646
"related_keywords": [
47-
"extract email from webpage",
48-
"extract all emails from website",
49-
"extract email from website",
50-
"web scraping email addresses",
51-
"scrape emails from website free",
47+
"free email scraping tool",
5248
"website email scraper",
53-
"how to scrap email addresses from website",
54-
"scrape emails for free"
49+
"web email scraper",
50+
"best free online email extractor",
51+
"how to delete emails from website",
52+
"pull email addresses from website",
53+
"extract email from website free",
54+
"extract emails from website",
55+
"free email grabber",
56+
"extract email address from website",
57+
"extract email addresses from website",
58+
"email extractor from website free",
59+
"free email scraping tool",
60+
"website email scraper",
61+
"web email scraper",
62+
"best free online email extractor",
63+
"how to delete emails from website",
64+
"pull email addresses from website",
65+
"extract email from website free",
66+
"extract emails from website",
67+
"free email grabber",
68+
"extract email address from website",
69+
"extract email addresses from website",
70+
"email extractor from website free"
5571
]
5672
}

‎bing-scraper/results/rich_snippets.json‎

Lines changed: 6 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -1,18 +1,8 @@
11
{
2-
"title": "Google Chrome",
3-
"link": "https://bing.com/alink/link?url=https%3a%2f%2fwww.google.com%2fchrome%2f&source=serp-rr&h=0SS6iQXs6bC8dov4LbCztjsdUlldoiy7EapBUCzhG7I%3d&p=kcoffcialwebsite",
4-
"heading": "Cross-platform web browser",
5-
"links": {
6-
"Wikipedia": "https://en.wikipedia.org/wiki/Google_Chrome",
7-
"Facebook": "https://www.facebook.com/googlechrome/",
8-
"Twitter": "https://twitter.com/googlechrome",
9-
"YouTube": "https://www.youtube.com/googlechrome"
10-
},
11-
"info": {
12-
"Developer(s)": "Google",
13-
"Written in": "C, C++, Assembly, HTML, Java (Android app only), JavaScript, Python",
14-
"Engines": "Blink (WebKit on iOS), V8 JavaScript engine",
15-
"Operating system": "Android Oreo or later · ChromeOS · iOS 15 or later · Linux · macOS 10.15 or later · Windows 10 or later"
16-
},
17-
"descrption": "Microsoft Edge has a built-in edge, but Chrome beats it out in everyday use and benchmark tests. So, which browser should you choose?computertechnicians.com.auChrome provides quick access to Google’s services. It also uses the Google search engine and displays videos on other devices. It even connects to a Chromecast device for video output.\n[84] [85] They are supported by the browser's desktop edition. [86] [86] [91] In 2014, Google started preventing some Windows users from installing extensions not hosted on the Chrome Web Store. [94]en.wikipedia.orgThe JavaScript virtual machine used by Chrome, the V8 JavaScript engine, has features such as dynamic code generation, hidden class transitions, and precise garbage collection.\nLearn more about Chrome and speed. Tabs help you stay organized, keep track of multiple pages, and multi-task.techspot.comChrome is designed to be fast in every possible way: It's quick to start up from your desktop, loads web pages in a snap, and runs complex web applications fast.\n"
2+
"title": "",
3+
"link": null,
4+
"heading": "",
5+
"links": {},
6+
"info": {},
7+
"descrption": ""
188
}

0 commit comments

Comments
 (0)