A comprehensive system for scraping and processing Medium articles with three interfaces:
- Apify Actor - Cloud scraping
- MCP Server - Claude Desktop integration
- Gradio UI - Web interface
See component-specific READMEs:
- Medium-Scraper - Apify Actor for cloud scraping
- medium-mcp-server - MCP server for Claude Desktop
- β‘ 15x Faster Scraping: New GraphQL-first architecture reduces scrape time from ~30s to ~2s.
- π¨ HTML Export: Full-fidelity HTML output with syntax highlighting, images, and author cards.
- π§ Analyst Intelligence: Deep content analysis reports with PDF export and TTS generation.
- π§ͺ Comprehensive Testing: Unified test suite for end-to-end verification.
- π‘οΈ Enhanced Resilience: Shared configuration, rate limiting, and circuit breakers.
For details, see:
Both components share a centralized configuration system. Create .env from .env.example:
cp .env.example .env
# Edit .env with your settingsKey configuration options:
- API Keys:
GEMINI_API_KEY,OPENAI_API_KEY,ELEVENLABS_API_KEY - Rate Limiting:
RATE_LIMIT_RPM=60(requests per minute) - Workers:
MAX_WORKERS=5(parallel processing) - Resilience:
CIRCUIT_BREAKER_THRESHOLD=5(failure threshold)
See .env.example for all 30+ configuration options.
- Implementation Guide: IMPLEMENTATION_SUMMARY.md
- Environment Setup: .env.example
- Verification: VERIFICATION_REPORT.md
- Testing: Run
python test_implementation.py
βββββββββββββββββββββββββββββββββββββββββββ
β Medium Agent Ecosystem β
βββββββββββββββββββββββββββββββββββββββββββ€
β β
β βββββββββββββββ ββββββββββββββββββββ β
β β Shared β β Shared Error β β
β β Config β β Handling β β
β βββββββ¬ββββββββ ββββββββββ¬ββββββββββ β
β β β β
β ββββββ΄βββββββββββ¬βββββββββ΄ββββββ β
β β β β β
β βΌ βΌ βΌ β
β ββββββββββ ββββββββββββ ββββββββββ β
β β Scraperβ β MCP β βGradio β β
β β (Apify)β β Server β β UI β β
β ββββββββββ ββββββββββββ ββββββββββ β
β β
βββββββββββββββββββββββββββββββββββββββββββ
All improvements are 100% backward compatible:
- β Existing Apify Actors work unchanged
- β Claude MCP integration unchanged
- β Gradio UI unchanged
- β No migration required
MIT
T0X1N
For detailed component documentation, see individual README files in each directory.