|
| 1 | +# 🌐 ScrapeGraph AI SDKs |
| 2 | + |
| 3 | +[](https://opensource.org/licenses/MIT) |
| 4 | +[](https://github.com/ScrapeGraphAI/scrapegraph-sdk/tree/main/scrapegraph-py) |
| 5 | +[](https://github.com/ScrapeGraphAI/scrapegraph-sdk/tree/main/scrapegraph-js) |
| 6 | +[](https://scrapegraphai.com/docs) |
| 7 | + |
| 8 | +Official SDKs for the ScrapeGraph AI API - Intelligent web scraping powered by AI. Extract structured data from any webpage with natural language prompts. |
| 9 | + |
| 10 | +The credits can be bougth [here](https://scrapegraphai.com)! |
| 11 | + |
| 12 | +## 🚀 Quick Links |
| 13 | + |
| 14 | +- [Python SDK Documentation](scrapegraph-py/README.md) |
| 15 | +- [JavaScript SDK Documentation](scrapegraph-js/README.md) |
| 16 | +- [API Documentation](https://scrapegraphai.com/docs) |
| 17 | +- [Website](https://scrapegraphai.com) |
| 18 | + |
| 19 | +## 📦 Installation |
| 20 | + |
| 21 | +### Python |
| 22 | +```bash |
| 23 | +pip install scrapegraph-py |
| 24 | +``` |
| 25 | + |
| 26 | +### JavaScript |
| 27 | +```bash |
| 28 | +npm install scrapegraph-js |
| 29 | +``` |
| 30 | + |
| 31 | +## 🎯 Core Features |
| 32 | + |
| 33 | +- 🤖 **AI-Powered Extraction**: Use natural language to describe what data you want |
| 34 | +- 📊 **Structured Output**: Get clean, structured data with optional schema validation |
| 35 | +- 🔄 **Multiple Formats**: Extract data as JSON, Markdown, or custom schemas |
| 36 | +- ⚡ **High Performance**: Concurrent processing and automatic retries |
| 37 | +- 🔒 **Enterprise Ready**: Production-grade security and rate limiting |
| 38 | + |
| 39 | +## 🛠️ Available Endpoints |
| 40 | + |
| 41 | +### 🔍 SmartScraper |
| 42 | +Extract structured data from any webpage using natural language prompts. |
| 43 | + |
| 44 | +### 📝 Markdownify |
| 45 | +Convert any webpage into clean, formatted markdown. |
| 46 | + |
| 47 | +### 💻 LocalScraper |
| 48 | +Extract information from a local HTML file using AI. |
| 49 | + |
| 50 | + |
| 51 | +## 🌟 Key Benefits |
| 52 | + |
| 53 | +- 📝 **Natural Language Queries**: No complex selectors or XPath needed |
| 54 | +- 🎯 **Precise Extraction**: AI understands context and structure |
| 55 | +- 🔄 **Adaptive Scraping**: Works with dynamic and static content |
| 56 | +- 📊 **Schema Validation**: Ensure data consistency with Pydantic/TypeScript |
| 57 | +- ⚡ **Async Support**: Handle multiple requests efficiently |
| 58 | + |
| 59 | +## 💡 Use Cases |
| 60 | + |
| 61 | +- 🏢 **Business Intelligence**: Extract company information and contacts |
| 62 | +- 📊 **Market Research**: Gather product data and pricing |
| 63 | +- 📰 **Content Aggregation**: Convert articles to structured formats |
| 64 | +- 🔍 **Data Mining**: Extract specific information from multiple sources |
| 65 | +- 📱 **App Integration**: Feed clean data into your applications |
| 66 | + |
| 67 | +## 📖 Documentation |
| 68 | + |
| 69 | +For detailed documentation and examples, visit: |
| 70 | +- [Python SDK Guide](scrapegraph-py/README.md) |
| 71 | +- [JavaScript SDK Guide](scrapegraph-js/README.md) |
| 72 | +- [API Documentation](https://scrapegraphai.com/docs) |
| 73 | + |
| 74 | +## 💬 Support & Feedback |
| 75 | + |
| 76 | + |
| 77 | +- 💻 GitHub Issues: [Create an issue](https://github.com/ScrapeGraphAI/scrapegraph-sdk/issues) |
| 78 | +- 🌟 Feature Requests: [Request a feature](https://github.com/ScrapeGraphAI/scrapegraph-sdk/issues/new) |
| 79 | + |
| 80 | +## 📄 License |
| 81 | + |
| 82 | +This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details. |
| 83 | + |
| 84 | +--- |
| 85 | + |
| 86 | +Made with ❤️ by [ScrapeGraph AI](https://scrapegraphai.com) |
0 commit comments