diff --git a/docs/korean.md b/docs/korean.md index 756b9e71..9a33e040 100644 --- a/docs/korean.md +++ b/docs/korean.md @@ -1,7 +1,7 @@ # ๐Ÿ•ท๏ธ ScrapeGraphAI: ํ•œ ๋ฐฉ์— ๋๋‚ด๋Š” ์›น์Šคํฌ๋ž˜ํ•‘ -ScrapeGraphAI๋Š” ์›น ์‚ฌ์ดํŠธ์™€ ๋กœ์ปฌ ๋ฌธ์„œ(XML, HTML, JSON ๋“ฑ)์— ๋Œ€ํ•œ ์Šคํฌ๋ž˜ํ•‘ ํŒŒ์ดํ”„๋ผ์ธ์„ ๋งŒ๋“ค๊ธฐ ์œ„ํ•ด LLM ๋ฐ ์ง์ ‘ ๊ทธ๋ž˜ํ”„ ๋กœ์ง์„ ์‚ฌ์šฉํ•˜๋Š” ํŒŒ์ด์ฌ ์›น์Šคํฌ๋ž˜ํ•‘ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค. +[ScrapeGraphAI](https://scrapegraphai.com)๋Š” ์›น ์‚ฌ์ดํŠธ์™€ ๋กœ์ปฌ ๋ฌธ์„œ(XML, HTML, JSON ๋“ฑ)์— ๋Œ€ํ•œ ์Šคํฌ๋ž˜ํ•‘ ํŒŒ์ดํ”„๋ผ์ธ์„ ๋งŒ๋“ค๊ธฐ ์œ„ํ•ด LLM ๋ฐ ์ง์ ‘ ๊ทธ๋ž˜ํ”„ ๋กœ์ง์„ ์‚ฌ์šฉํ•˜๋Š” ํŒŒ์ด์ฌ ์›น์Šคํฌ๋ž˜ํ•‘ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์ž…๋‹ˆ๋‹ค. ์ถ”์ถœํ•˜๋ ค๋Š” ์ •๋ณด๋ฅผ ๋งํ•˜๊ธฐ๋งŒ ํ•˜๋ฉด ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๊ฐ€ ์•Œ์•„์„œ ์ฒ˜๋ฆฌํ•ด ์ค๋‹ˆ๋‹ค! @@ -9,206 +9,167 @@ ScrapeGraphAI๋Š” ์›น ์‚ฌ์ดํŠธ์™€ ๋กœ์ปฌ ๋ฌธ์„œ(XML, HTML, JSON ๋“ฑ)์— ๋Œ€ํ•œ ScrapeGraphAI Hero

+## ๐Ÿš€ ํ†ตํ•ฉ +ScrapeGraphAI๋Š” ์ธ๊ธฐ ์žˆ๋Š” ํ”„๋ ˆ์ž„์›Œํฌ ๋ฐ ๋„๊ตฌ์™€์˜ ์›ํ™œํ•œ ํ†ตํ•ฉ์„ ์ œ๊ณตํ•˜์—ฌ ์Šคํฌ๋ž˜ํ•‘ ๋Šฅ๋ ฅ์„ ํ–ฅ์ƒ์‹œํ‚ต๋‹ˆ๋‹ค. ํŒŒ์ด์ฌ์ด๋“  Node.js๋กœ ๊ฐœ๋ฐœํ•˜๋“ , LLM ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ์‚ฌ์šฉํ•˜๋“ , ๋…ธ์ฝ”๋“œ ํ”Œ๋žซํผ์ด๋“  ์ €ํฌ์˜ ํฌ๊ด„์ ์ธ ํ†ตํ•ฉ ์˜ต์…˜์„ ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค. + +๋” ๋งŽ์€ ์ •๋ณด๋Š” ๋‹ค์Œ [๋งํฌ](https://scrapegraphai.com)์—์„œ ํ™•์ธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค + +**Integrations**: +- **API**: [Documentation](https://docs.scrapegraphai.com/introduction) +- **SDKs**: [Python](https://docs.scrapegraphai.com/sdks/python), [Node](https://docs.scrapegraphai.com/sdks/javascript) +- **LLM Frameworks**: [Langchain](https://docs.scrapegraphai.com/integrations/langchain), [Llama Index](https://docs.scrapegraphai.com/integrations/llamaindex), [Crew.ai](https://docs.scrapegraphai.com/integrations/crewai), [Agno](https://docs.scrapegraphai.com/integrations/agno), [CamelAI](https://github.com/camel-ai/camel) +- **Low-code Frameworks**: [Pipedream](https://pipedream.com/apps/scrapegraphai), [Bubble](https://bubble.io/plugin/scrapegraphai-1745408893195x213542371433906180), [Zapier](https://zapier.com/apps/scrapegraphai/integrations), [n8n](http://localhost:5001/dashboard), [Dify](https://dify.ai), [Toolhouse](https://app.toolhouse.ai/mcp-servers/scrapegraph_smartscraper) +- **MCP server**: [Link](https://smithery.ai/server/@ScrapeGraphAI/scrapegraph-mcp) + ## ๐Ÿš€ ๋น ๋ฅธ ์„ค์น˜ Scrapegraph-ai์— ๋Œ€ํ•œ ์ฐธ์กฐ ํŽ˜์ด์ง€๋Š” PyPI์˜ ๊ณต์‹ ํŽ˜์ด์ง€์—์„œ ํ™•์ธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค: [pypi](https://pypi.org/project/scrapegraphai/). ```bash pip install scrapegraphai + +# ์ค‘์š” (์›น์‚ฌ์ดํŠธ ์Šคํฌ๋ž˜ํ•‘์„ ์œ„ํ•œ ์„ค์น˜) +playwright install ``` ์ฐธ๊ณ : ๋‹ค๋ฅธ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ์™€์˜ ์ถฉ๋Œ์„ ํ”ผํ•˜๊ธฐ ์œ„ํ•ด ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋ฅผ ๊ฐ€์ƒ ํ™˜๊ฒฝ์— ์„ค์น˜ํ•˜๋Š” ๊ฒƒ์ด ์ข‹์Šต๋‹ˆ๋‹ค ๐Ÿฑ -## ๐Ÿ” ๋ฐ๋ชจ - -๊ณต์‹ Streamlit ๋ฐ๋ชจ: - -[![My Skills](https://skillicons.dev/icons?i=react)](https://scrapegraph-ai-web-dashboard.streamlit.app) - - -Google Colab์„ ์‚ฌ์šฉํ•˜์—ฌ ์›น์—์„œ ์ง์ ‘ ์‚ฌ์šฉํ•ด ๋ณด์„ธ์š”: - -[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1sEZBonBMGP44CtO6GQTwAlL0BGJXjtfd?usp=sharing) - - -## ๐Ÿ“– ๋ฌธ์„œ - -ScrapeGraphAI์— ๋Œ€ํ•œ ๋ฌธ์„œ๋Š” [์—ฌ๊ธฐ](https://scrapegraph-ai.readthedocs.io/en/latest/)์—์„œ ์ฐพ์„ ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. - -๋˜ํ•œ Docusaurus๋ฅผ [์—ฌ๊ธฐ](https://scrapegraph-doc.onrender.com/)์—์„œ ํ™•์ธํ•ด ๋ณด์„ธ์š”. - ## ๐Ÿ’ป ์‚ฌ์šฉ๋ฒ• +์›น์‚ฌ์ดํŠธ(๋˜๋Š” ๋กœ์ปฌ ํŒŒ์ผ)์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๊ธฐ ์œ„ํ•ด ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋Š” ์—ฌ๋Ÿฌ ํ‘œ์ค€ ์Šคํฌ๋ž˜ํ•‘ ํŒŒ์ดํ”„๋ผ์ธ์ด ์žˆ์Šต๋‹ˆ๋‹ค. -์›น์‚ฌ์ดํŠธ(๋˜๋Š” ๋กœ์ปฌ ํŒŒ์ผ)์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๊ธฐ ์œ„ํ•ด ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋Š” ์—ฌ๋Ÿฌ ํ‘œ์ค€ ์Šคํฌ๋ž˜ํ•‘ ํŒŒ์ดํ”„๋ผ์ธ์ด ์žˆ์Šต๋‹ˆ๋‹ค: -- `SmartScraperGraph`: ์‚ฌ์šฉ์ž ํ”„๋กฌํ”„ํŠธ์™€ ์ž…๋ ฅ ์†Œ์Šค๋งŒ ํ•„์š”๋กœ ํ•˜๋Š” ๋‹จ์ผ ํŽ˜์ด์ง€ ์Šคํฌ๋ž˜ํผ์ž…๋‹ˆ๋‹ค. -- `SearchGraph`: ๊ฒ€์ƒ‰ ์—”์ง„์˜ ์ƒ์œ„ n๊ฐœ ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๋Š” ๋‹ค์ค‘ ํŽ˜์ด์ง€ ์Šคํฌ๋ž˜ํผ์ž…๋‹ˆ๋‹ค. -- `SpeechGraph`: ์›น์‚ฌ์ดํŠธ์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๊ณ  ์˜ค๋””์˜ค ํŒŒ์ผ์„ ์ƒ์„ฑํ•˜๋Š” ๋‹จ์ผ ํŽ˜์ด์ง€ ์Šคํฌ๋ž˜ํผ์ž…๋‹ˆ๋‹ค. -- `ScriptCreatorGraph`: ์›น์‚ฌ์ดํŠธ์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๊ณ  Python ์Šคํฌ๋ฆฝํŠธ๋ฅผ ์ƒ์„ฑํ•˜๋Š” ๋‹จ์ผ ํŽ˜์ด์ง€ ์Šคํฌ๋ž˜ํผ์ž…๋‹ˆ๋‹ค. - -- `SmartScraperMultiGraph`: ๋‹จ์ผ ํ”„๋กฌํ”„ํŠธ์™€ ์†Œ์Šค ๋ชฉ๋ก์„ ์‚ฌ์šฉํ•˜์—ฌ ์—ฌ๋Ÿฌ ํŽ˜์ด์ง€์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๋Š” ๋‹ค์ค‘ ํŽ˜์ด์ง€ ์Šคํฌ๋ž˜ํผ์ž…๋‹ˆ๋‹ค. -- `ScriptCreatorMultiGraph`: ๋‹จ์ผ ํ”„๋กฌํ”„ํŠธ์™€ ์†Œ์Šค ๋ชฉ๋ก์„ ์‚ฌ์šฉํ•˜์—ฌ ์—ฌ๋Ÿฌ ํŽ˜์ด์ง€์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๋Š” Python ์Šคํฌ๋ฆฝํŠธ๋ฅผ ์ƒ์„ฑํ•˜๋Š” ๋‹ค์ค‘ ํŽ˜์ด์ง€ ์Šคํฌ๋ž˜ํผ์ž…๋‹ˆ๋‹ค. +๊ฐ€์žฅ ์ผ๋ฐ˜์ ์ธ ๊ฒƒ์€ `SmartScraperGraph`๋กœ, ์‚ฌ์šฉ์ž ํ”„๋กฌํ”„ํŠธ์™€ ์†Œ์Šค URL์ด ์ฃผ์–ด์ง„ ๋‹จ์ผ ํŽ˜์ด์ง€์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•ฉ๋‹ˆ๋‹ค. -**OpenAI**, **Groq**, **Azure**, **Gemini**์™€ ๊ฐ™์€ API๋ฅผ ํ†ตํ•ด ๋‹ค์–‘ํ•œ LLM์„ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, **Ollama**๋ฅผ ์‚ฌ์šฉํ•˜์—ฌ ๋กœ์ปฌ ๋ชจ๋ธ๋„ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. - -### ์‚ฌ๋ก€ 1: ๋กœ์ปฌ ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•˜๋Š” SmartScraper -[Ollama](https://ollama.com/)๋ฅผ ์„ค์น˜ํ•˜๊ณ  **ollama pull** ๋ช…๋ น์„ ์‚ฌ์šฉํ•˜์—ฌ ๋ชจ๋ธ์„ ๋‹ค์šด๋กœ๋“œํ•˜์„ธ์š”. ```python from scrapegraphai.graphs import SmartScraperGraph +# ์Šคํฌ๋ž˜ํ•‘ ํŒŒ์ดํ”„๋ผ์ธ์— ๋Œ€ํ•œ ๊ตฌ์„ฑ ์ •์˜ graph_config = { "llm": { - "model": "ollama/mistral", - "temperature": 0, - "format": "json", # Ollama needs the format to be specified explicitly - "base_url": "http://localhost:11434", # set Ollama URL - }, - "embeddings": { - "model": "ollama/nomic-embed-text", - "base_url": "http://localhost:11434", # set Ollama URL + "model": "ollama/llama3.2", + "model_tokens": 8192 }, "verbose": True, + "headless": False, } +# SmartScraperGraph ์ธ์Šคํ„ด์Šค ์ƒ์„ฑ smart_scraper_graph = SmartScraperGraph( - prompt="List me all the projects with their descriptions", - # also accepts a string with the already downloaded HTML code - source="https://perinim.github.io/projects", + prompt="Extract useful information from the webpage, including a description of what the company does, founders and social media links", + source="https://scrapegraphai.com/", config=graph_config ) +# ํŒŒ์ดํ”„๋ผ์ธ ์‹คํ–‰ result = smart_scraper_graph.run() -print(result) -``` -์ถœ๋ ฅ์€ ๋‹ค์Œ๊ณผ ๊ฐ™์ด ํ”„๋กœ์ ํŠธ์™€ ์„ค๋ช…์˜ ๋ชฉ๋ก์ด ๋  ๊ฒƒ์ž…๋‹ˆ๋‹ค: - -```python -{'projects': [{'title': 'Rotary Pendulum RL', 'description': 'Open Source project aimed at controlling a real life rotary pendulum using RL algorithms'}, {'title': 'DQN Implementation from scratch', 'description': 'Developed a Deep Q-Network algorithm to train a simple and double pendulum'}, ...]} +import json +print(json.dumps(result, indent=4)) ``` -### ์‚ฌ๋ก€ 2: ํ˜ผํ•ฉ ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•˜๋Š” SearchGraph -์šฐ๋ฆฌ๋Š” LLM์— **Groq**๋ฅผ ์‚ฌ์šฉํ•˜๊ณ , ์ž„๋ฒ ๋”ฉ์— **Ollama**๋ฅผ ์‚ฌ์šฉํ•ฉ๋‹ˆ๋‹ค. +> [!NOTE] +> OpenAI๋‚˜ ๋‹ค๋ฅธ ๋ชจ๋ธ๋“ค์€ LLM ์„ค์ •๋งŒ ๋ฐ”๊พธ๋ฉด ๋ฉ๋‹ˆ๋‹ค! +> ```python +>graph_config = { +> "llm": { +> "api_key": "YOUR_OPENAI_API_KEY", +> "model": "openai/gpt-4o-mini", +> }, +> "verbose": True, +> "headless": False, +>} +>``` -```python -from scrapegraphai.graphs import SearchGraph -# Define the configuration for the graph -graph_config = { - "llm": { - "model": "groq/gemma-7b-it", - "api_key": "GROQ_API_KEY", - "temperature": 0 - }, - "embeddings": { - "model": "ollama/nomic-embed-text", - "base_url": "http://localhost:11434", # set ollama URL arbitrarily - }, - "max_results": 5, -} - -# Create the SearchGraph instance -search_graph = SearchGraph( - prompt="List me all the traditional recipes from Chioggia", - config=graph_config -) - -# Run the graph -result = search_graph.run() -print(result) -``` - -์ถœ๋ ฅ์€ ๋‹ค์Œ๊ณผ ๊ฐ™์ด ๋ ˆ์‹œํ”ผ ๋ชฉ๋ก์ด ๋  ๊ฒƒ์ž…๋‹ˆ๋‹ค: +์ถœ๋ ฅ์€ ๋‹ค์Œ๊ณผ ๊ฐ™์€ dictionary ํ˜•ํƒœ๊ฐ€ ๋  ๊ฒƒ์ž…๋‹ˆ๋‹ค ```python -{'recipes': [{'name': 'Sarde in Saรฒre'}, {'name': 'Bigoli in salsa'}, {'name': 'Seppie in umido'}, {'name': 'Moleche frite'}, {'name': 'Risotto alla pescatora'}, {'name': 'Broeto'}, {'name': 'Bibarasse in Cassopipa'}, {'name': 'Risi e bisi'}, {'name': 'Smegiassa Ciosota'}]} +{ + "description": "ScrapeGraphAI transforms websites into clean, organized data for AI agents and data analytics. It offers an AI-powered API for effortless and cost-effective data extraction.", + "founders": [ + { + "name": "", + "role": "Founder & Technical Lead", + "linkedin": "https://www.linkedin.com/in/perinim/" + }, + { + "name": "Marco Vinciguerra", + "role": "Founder & Software Engineer", + "linkedin": "https://www.linkedin.com/in/marco-vinciguerra-7ba365242/" + }, + { + "name": "Lorenzo Padoan", + "role": "Founder & Product Engineer", + "linkedin": "https://www.linkedin.com/in/lorenzo-padoan-4521a2154/" + } + ], + "social_media_links": { + "linkedin": "https://www.linkedin.com/company/101881123", + "twitter": "https://x.com/scrapegraphai", + "github": "https://github.com/ScrapeGraphAI/Scrapegraph-ai" + } +} ``` -### ์‚ฌ๋ก€ 3: OpenAI๋ฅผ ์‚ฌ์šฉํ•˜๋Š” SpeechGraph +์—ฌ๋Ÿฌ ํŽ˜์ด์ง€์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๊ฑฐ๋‚˜, Python ์Šคํฌ๋ฆฝํŠธ๋ฅผ ์ƒ์„ฑํ•˜๊ฑฐ๋‚˜, ์‹ฌ์ง€์–ด ์˜ค๋””์˜ค ํŒŒ์ผ์„ ์ƒ์„ฑํ•˜๋Š” ๋ฐ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ๋Š” ๋‹ค๋ฅธ ํŒŒ์ดํ”„๋ผ์ธ๋„ ์žˆ์Šต๋‹ˆ๋‹ค. -OpenAI API ํ‚ค์™€ ๋ชจ๋ธ ์ด๋ฆ„๋งŒ ์ „๋‹ฌํ•˜๋ฉด ๋ฉ๋‹ˆ๋‹ค. +| ํŒŒ์ดํ”„๋ผ์ธ | ์„ค๋ช… | +|-------------------------|------------------------------------------------------------------------------------------------------------------| +| SmartScraperGraph | ์‚ฌ์šฉ์ž ํ”„๋กฌํ”„ํŠธ์™€ ์ž…๋ ฅ ์†Œ์Šค๋งŒ ์žˆ์œผ๋ฉด ๋˜๋Š” ๋‹จ์ผ ํŽ˜์ด์ง€ ์Šคํฌ๋ž˜ํผ์ž…๋‹ˆ๋‹ค. + | +| SearchGraph | ๊ฒ€์ƒ‰ ์—”์ง„์˜ ์ƒ์œ„ n๊ฐœ ๊ฒ€์ƒ‰ ๊ฒฐ๊ณผ์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๋Š” ๋‹ค์ค‘ ํŽ˜์ด์ง€ ์Šคํฌ๋ž˜ํผ์ž…๋‹ˆ๋‹ค. | +| SpeechGraph | ์›น์‚ฌ์ดํŠธ์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๊ณ  ์˜ค๋””์˜ค ํŒŒ์ผ์„ ์ƒ์„ฑํ•˜๋Š” ๋‹จ์ผ ํŽ˜์ด์ง€ ์Šคํฌ๋ž˜ํผ์ž…๋‹ˆ๋‹ค. | +| ScriptCreatorGraph | ์›น์‚ฌ์ดํŠธ์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๊ณ  ํŒŒ์ด์ฌ ์Šคํฌ๋ฆฝํŠธ๋ฅผ ์ƒ์„ฑํ•˜๋Š” ๋‹จ์ผ ํŽ˜์ด์ง€ ์Šคํฌ๋ž˜ํผ์ž…๋‹ˆ๋‹ค. + | +| SmartScraperMultiGraph | ๋‹จ์ผ ํ”„๋กฌํ”„ํŠธ์™€ ์ถœ์ฒ˜ ๋ชฉ๋ก์ด ์ฃผ์–ด์ง€๋ฉด ์—ฌ๋Ÿฌ ํŽ˜์ด์ง€์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๋Š” ๋‹ค์ค‘ ํŽ˜์ด์ง€ ์Šคํฌ๋ž˜ํผ์ž…๋‹ˆ๋‹ค. | +| ScriptCreatorMultiGraph | ์—ฌ๋Ÿฌ ํŽ˜์ด์ง€์™€ ์†Œ์Šค์—์„œ ์ •๋ณด๋ฅผ ์ถ”์ถœํ•˜๊ธฐ ์œ„ํ•œ ํŒŒ์ด์ฌ ์Šคํฌ๋ฆฝํŠธ๋ฅผ ์ƒ์„ฑํ•˜๋Š” ๋‹ค์ค‘ ํŽ˜์ด์ง€ ์Šคํฌ๋ž˜ํผ์ž…๋‹ˆ๋‹ค. | -```python -from scrapegraphai.graphs import SpeechGraph +๊ฐ ๊ทธ๋ž˜ํ”„์—๋Š” ๋‹ค์ค‘ ๋ฒ„์ „์ด ์žˆ์Šต๋‹ˆ๋‹ค. ์ด๋ฅผ ํ†ตํ•ด LLM์„ ๋ณ‘๋ ฌ๋กœ ํ˜ธ์ถœํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. -graph_config = { - "llm": { - "api_key": "OPENAI_API_KEY", - "model": "openai/gpt-3.5-turbo", - }, - "tts_model": { - "api_key": "OPENAI_API_KEY", - "model": "tts-1", - "voice": "alloy" - }, - "output_path": "audio_summary.mp3", -} +OpenAI, Groq, Azure, Gemini์™€ ๊ฐ™์€ API๋ฅผ ํ†ตํ•ด ๋‹ค์–‘ํ•œ LLM์„ ์‚ฌ์šฉํ•  ์ˆ˜ ์žˆ์œผ๋ฉฐ, Ollama๋ฅผ ์ด์šฉํ•œ ๋กœ์ปฌ ๋ชจ๋ธ๋„ ๊ฐ€๋Šฅํ•ฉ๋‹ˆ๋‹ค. -# ************************************************ -# Create the SpeechGraph instance and run it -# ************************************************ +๋กœ์ปฌ ๋ชจ๋ธ์„ ์‚ฌ์šฉํ•˜๋ ค๋ฉด [Ollama](https://ollama.com/)๋ฅผ ์„ค์น˜ํ•˜๊ณ  ollama pull ๋ช…๋ น์„ ์‚ฌ์šฉํ•˜์—ฌ ๋ชจ๋ธ์„ ๋‹ค์šด๋กœ๋“œํ•ด์•ผ ํ•ฉ๋‹ˆ๋‹ค. -speech_graph = SpeechGraph( - prompt="Make a detailed audio summary of the projects.", - source="https://perinim.github.io/projects/", - config=graph_config, -) -result = speech_graph.run() -print(result) +## ๐Ÿ“– Documentation -``` +[![Colab์œผ๋กœ ์—ด๊ธฐ](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/drive/1sEZBonBMGP44CtO6GQTwAlL0BGJXjtfd?usp=sharing) -์ถœ๋ ฅ์€ ํŽ˜์ด์ง€์˜ ํ”„๋กœ์ ํŠธ ์š”์•ฝ์ด ํฌํ•จ๋œ ์˜ค๋””์˜ค ํŒŒ์ผ์ด ๋  ๊ฒƒ์ž…๋‹ˆ๋‹ค. +ScrapeGraphAI ๊ด€๋ จ ๋ฌธ์„œ๋Š” [์—ฌ๊ธฐ](https://scrapegraph-ai.readthedocs.io/en/latest/)์—์„œ ํ™•์ธํ•˜์‹ค ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. +Docusaurus๋„ [์—ฌ๊ธฐ](https://docs-oss.scrapegraphai.com/)์—์„œ ํ™•์ธํ•ด ๋ณด์„ธ์š”. -## ์Šคํฐ +## ๐Ÿค Contributing -
- - SerpAPI - - - Stats - -
+์ž์œ ๋กญ๊ฒŒ ๊ธฐ์—ฌํ•˜๊ณ  Discord ์„œ๋ฒ„์— ์ฐธ์—ฌํ•˜์—ฌ ๊ฐœ์„  ์‚ฌํ•ญ์„ ๋…ผ์˜ํ•˜๊ณ  ์ œ์•ˆํ•ด ์ฃผ์„ธ์š”! -## ๐Ÿค ๊ธฐ์—ฌ +[๊ธฐ์—ฌ ๊ฐ€์ด๋“œ๋ผ์ธ](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/CONTRIBUTING.md)์„ ์ฐธ๊ณ ํ•˜์„ธ์š”. -๊ธฐ์—ฌ๋ฅผ ํ™˜์˜ํ•˜๋ฉฐ, ๊ฐœ์„  ์‚ฌํ•ญ์„ ๋…ผ์˜ํ•˜๊ณ  ์ œ์•ˆ ์‚ฌํ•ญ์„ ์ฃผ๊ณ ๋ฐ›๊ธฐ ์œ„ํ•ด ์šฐ๋ฆฌ์˜ Discord ์„œ๋ฒ„์— ์ฐธ์—ฌํ•˜์„ธ์š”! +[![My Skills](https://skillicons.dev/icons?i=discord)](https://discord.gg/uJN7TYcpNa) +[![My Skills](https://skillicons.dev/icons?i=linkedin)](https://www.linkedin.com/company/scrapegraphai/) +[![My Skills](https://skillicons.dev/icons?i=twitter)](https://twitter.com/scrapegraphai) -๊ธฐ์—ฌ ๊ฐ€์ด๋“œ๋ผ์ธ์„ ์ฐธ๊ณ ํ•ด์ฃผ์„ธ์š”: [contributing guidelines](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/CONTRIBUTING.md). +## ๐Ÿ”— ScrapeGraph API & SDKs +์‹œ์Šคํ…œ์— ScrapeGraph๋ฅผ ํ†ตํ•ฉํ•˜๊ธฐ ์œ„ํ•œ ๋น ๋ฅธ ์†”๋ฃจ์…˜์„ ์ฐพ๊ณ  ์žˆ๋‹ค๋ฉด, [์—ฌ๊ธฐ!](https://dashboard.scrapegraphai.com/login)์—์„œ ๊ฐ•๋ ฅํ•œ API๋ฅผ ํ™•์ธํ•ด ๋ณด์„ธ์š”. -## ๐Ÿ“ˆ ๋กœ๋“œ๋งต +

+ ScrapeGraph API Banner +

-๋‹ค์Œ ๊ธฐ๋Šฅ๋“ค์„ ์ž‘์—…ํ•˜๊ณ  ์žˆ์Šต๋‹ˆ๋‹ค! ํ˜‘์—…์— ๊ด€์‹ฌ์ด ์žˆ์œผ์‹œ๋ฉด ํ•ด๋‹น ๊ธฐ๋Šฅ์„ ๋งˆ์šฐ์Šค ์˜ค๋ฅธ์ชฝ ๋ฒ„ํŠผ์œผ๋กœ ํด๋ฆญํ•˜์—ฌ ์ƒˆ ํƒญ์—์„œ PR์„ ์ž‘์„ฑํ•ด์ฃผ์„ธ์š”. ์˜๋ฌธ์‚ฌํ•ญ์ด ์žˆ๊ฑฐ๋‚˜ ๋…ผ์˜ํ•˜๊ณ  ์‹ถ๋‹ค๋ฉด [Discord](https://discord.gg/uJN7TYcpNa)์—์„œ ์ €ํฌ์—๊ฒŒ ์—ฐ๋ฝํ•˜๊ฑฐ๋‚˜ Github์˜ [Discussion](https://github.com/VinciGit00/Scrapegraph-ai/discussions) ํŽ˜์ด์ง€๋ฅผ ์—ด์–ด์ฃผ์„ธ์š”! +Python๊ณผ Node.js SDK๋ฅผ ์ œ๊ณตํ•˜์—ฌ ํ”„๋กœ์ ํŠธ์— ์‰ฝ๊ฒŒ ํ†ตํ•ฉํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. ์•„๋ž˜์—์„œ ํ™•์ธํ•ด ๋ณด์„ธ์š”. -```mermaid -%%{init: {'theme': 'base', 'themeVariables': { 'primaryColor': '#5C4B9B', 'edgeLabelBackground':'#ffffff', 'tertiaryColor': '#ffffff', 'primaryBorderColor': '#5C4B9B', 'fontFamily': 'Arial', 'fontSize': '16px', 'textColor': '#5C4B9B' }}}%% -graph LR - A[DeepSearch Graph] --> F[Use Existing Chromium Instances] - F --> B[Page Caching] - B --> C[Screenshot Scraping] - C --> D[Handle Dynamic Content] - D --> E[New Webdrivers] +| SDK | Language | GitHub Link | +|-----------|----------|-----------------------------------------------------------------------------| +| Python SDK | Python | [scrapegraph-py](https://github.com/ScrapeGraphAI/scrapegraph-sdk/tree/main/scrapegraph-py) | +| Node.js SDK | Node.js | [scrapegraph-js](https://github.com/ScrapeGraphAI/scrapegraph-sdk/tree/main/scrapegraph-js) | - style A fill:#ffffff,stroke:#5C4B9B,stroke-width:2px,rx:10,ry:10 - style F fill:#ffffff,stroke:#5C4B9B,stroke-width:2px,rx:10,ry:10 - style B fill:#ffffff,stroke:#5C4B9B,stroke-width:2px,rx:10,ry:10 - style C fill:#ffffff,stroke:#5C4B9B,stroke-width:2px,rx:10,ry:10 - style D fill:#ffffff,stroke:#5C4B9B,stroke-width:2px,rx:10,ry:10 - style E fill:#ffffff,stroke:#5C4B9B,stroke-width:2px,rx:10,ry:10 +๊ณต์‹ API ๋ฌธ์„œ๋Š” [์—ฌ๊ธฐ](https://docs.scrapegraphai.com/)์—์„œ ํ™•์ธํ•  ์ˆ˜ ์žˆ์Šต๋‹ˆ๋‹ค. - click A href "https://github.com/VinciGit00/Scrapegraph-ai/issues/260" "Open DeepSearch Graph Issue" - click F href "https://github.com/VinciGit00/Scrapegraph-ai/issues/329" "Open Chromium Instances Issue" - click B href "https://github.com/VinciGit00/Scrapegraph-ai/issues/197" "Open Page Caching Issue" - click C href "https://github.com/VinciGit00/Scrapegraph-ai/issues/197" "Open Screenshot Scraping Issue" - click D href "https://github.com/VinciGit00/Scrapegraph-ai/issues/279" "Open Handle Dynamic Content Issue" - click E href "https://github.com/VinciGit00/Scrapegraph-ai/issues/171" "Open New Webdrivers Issue" -``` +## ๐Ÿ“ˆ Telemetry +์ €ํฌ๋Š” ํŒจํ‚ค์ง€์˜ ํ’ˆ์งˆ๊ณผ ์‚ฌ์šฉ์ž ๊ฒฝํ—˜์„ ํ–ฅ์ƒ์‹œํ‚ค๊ธฐ ์œ„ํ•ด ์ต๋ช…์˜ ์‚ฌ์šฉ ์ง€ํ‘œ๋ฅผ ์ˆ˜์ง‘ํ•ฉ๋‹ˆ๋‹ค. ์ด ๋ฐ์ดํ„ฐ๋Š” ๊ฐœ์„  ์‚ฌํ•ญ์˜ ์šฐ์„ ์ˆœ์œ„๋ฅผ ์ •ํ•˜๊ณ  ํ˜ธํ™˜์„ฑ์„ ๋ณด์žฅํ•˜๋Š” ๋ฐ ๋„์›€์ด ๋ฉ๋‹ˆ๋‹ค. ์˜ตํŠธ์•„์›ƒํ•˜๋ ค๋ฉด ํ™˜๊ฒฝ ๋ณ€์ˆ˜ SCRAPEGRAPHAI_TELEMETRY_ENABLED=false๋ฅผ ์„ค์ •ํ•˜์„ธ์š”. ์ž์„ธํ•œ ๋‚ด์šฉ์€ [์—ฌ๊ธฐ](https://scrapegraph-ai.readthedocs.io/en/latest/scrapers/telemetry.html)์—์„œ ์„ค๋ช…์„œ๋ฅผ ์ฐธ์กฐํ•˜์„ธ์š”. ## ๏ธ ๊ธฐ์—ฌ์ž๋“ค [![Contributors](https://contrib.rocks/image?repo=VinciGit00/Scrapegraph-ai)](https://github.com/VinciGit00/Scrapegraph-ai/graphs/contributors) ## ๐ŸŽ“ ์ธ์šฉ -์šฐ๋ฆฌ์˜ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋ฅผ ์—ฐ๊ตฌ ๋ชฉ์ ์œผ๋กœ ์‚ฌ์šฉํ•œ ๊ฒฝ์šฐ ๋‹ค์Œ๊ณผ ๊ฐ™์ด ์ธ์šฉํ•ด ์ฃผ์„ธ์š”: +์šฐ๋ฆฌ์˜ ๋ผ์ด๋ธŒ๋Ÿฌ๋ฆฌ๋ฅผ ์—ฐ๊ตฌ ๋ชฉ์ ์œผ๋กœ ์‚ฌ์šฉํ•œ ๊ฒฝ์šฐ ๋‹ค์Œ๊ณผ ๊ฐ™์ด ์ธ์šฉํ•ด ์ฃผ์„ธ์š” ```text @misc{scrapegraph-ai, author = {, Lorenzo Padoan, Marco Vinciguerra}, @@ -221,19 +182,14 @@ graph LR ## ์ €์ž๋“ค -

- Authors_logos -

- | | ์—ฐ๋ฝ์ฒ˜ | |--------------------|---------------| | Marco Vinciguerra | [![Linkedin Badge](https://img.shields.io/badge/-Linkedin-blue?style=flat&logo=Linkedin&logoColor=white)](https://www.linkedin.com/in/marco-vinciguerra-7ba365242/) | -| | [![Linkedin Badge](https://img.shields.io/badge/-Linkedin-blue?style=flat&logo=Linkedin&logoColor=white)](https://www.linkedin.com/in/perinim/) | | Lorenzo Padoan | [![Linkedin Badge](https://img.shields.io/badge/-Linkedin-blue?style=flat&logo=Linkedin&logoColor=white)](https://www.linkedin.com/in/lorenzo-padoan-4521a2154/) | ## ๐Ÿ“œ ๋ผ์ด์„ ์Šค -ScrapeGraphAI๋Š” MIT License๋กœ ๋ฐฐํฌ๋˜์—ˆ์Šต๋‹ˆ. ์ž์„ธํ•œ ๋‚ด์šฉ์€ [LICENSE](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/LICENSE) ํŒŒ์ผ์„ ์ฐธ์กฐํ•˜์„ธ์š”. +ScrapeGraphAI๋Š” MIT License๋กœ ๋ฐฐํฌ๋˜์—ˆ์Šต๋‹ˆ๋‹ค. ์ž์„ธํ•œ ๋‚ด์šฉ์€ [LICENSE](https://github.com/VinciGit00/Scrapegraph-ai/blob/main/LICENSE) ํŒŒ์ผ์„ ์ฐธ์กฐํ•˜์„ธ์š”. ## ๊ฐ์‚ฌ์˜ ๋ง