Skip to content

N1KH1LT0X1N/Medium-Agent

Folders and files

NameName
Last commit message
Last commit date

Latest commit

Β 

History

8 Commits
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 
Β 

Repository files navigation

Medium Agent Ecosystem

A comprehensive system for scraping and processing Medium articles with three interfaces:

  1. Apify Actor - Cloud scraping
  2. MCP Server - Claude Desktop integration
  3. Gradio UI - Web interface

🎯 Quick Start

See component-specific READMEs:

πŸ“‹ Recent Improvements

πŸš€ Major v3.0 Update (Dec 2025)

  • ⚑ 15x Faster Scraping: New GraphQL-first architecture reduces scrape time from ~30s to ~2s.
  • 🎨 HTML Export: Full-fidelity HTML output with syntax highlighting, images, and author cards.
  • 🧠 Analyst Intelligence: Deep content analysis reports with PDF export and TTS generation.
  • πŸ§ͺ Comprehensive Testing: Unified test suite for end-to-end verification.
  • πŸ›‘οΈ Enhanced Resilience: Shared configuration, rate limiting, and circuit breakers.

For details, see:

βš™οΈ Configuration

Both components share a centralized configuration system. Create .env from .env.example:

cp .env.example .env
# Edit .env with your settings

Key configuration options:

  • API Keys: GEMINI_API_KEY, OPENAI_API_KEY, ELEVENLABS_API_KEY
  • Rate Limiting: RATE_LIMIT_RPM=60 (requests per minute)
  • Workers: MAX_WORKERS=5 (parallel processing)
  • Resilience: CIRCUIT_BREAKER_THRESHOLD=5 (failure threshold)

See .env.example for all 30+ configuration options.

πŸ“š Documentation

πŸ—οΈ Architecture

β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”
β”‚      Medium Agent Ecosystem             β”‚
β”œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€
β”‚                                         β”‚
β”‚  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β” β”‚
β”‚  β”‚   Shared    β”‚  β”‚   Shared Error   β”‚ β”‚
β”‚  β”‚   Config    β”‚  β”‚    Handling      β”‚ β”‚
β”‚  β””β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”˜  β””β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜ β”‚
β”‚        β”‚                   β”‚           β”‚
β”‚   β”Œβ”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”¬β”€β”€β”€β”€β”€β”€β”€β”€β”΄β”€β”€β”€β”€β”€β”     β”‚
β”‚   β”‚               β”‚              β”‚     β”‚
β”‚   β–Ό               β–Ό              β–Ό     β”‚
β”‚ β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”  β”Œβ”€β”€β”€β”€β”€β”€β”€β”€β”  β”‚
β”‚ β”‚ Scraperβ”‚  β”‚   MCP    β”‚  β”‚Gradio β”‚  β”‚
β”‚ β”‚ (Apify)β”‚  β”‚  Server  β”‚  β”‚  UI   β”‚  β”‚  
β”‚ β””β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β””β”€β”€β”€β”€β”€β”€β”€β”€β”˜  β”‚
β”‚                                         β”‚
β””β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”€β”˜

πŸ”’ Zero Breaking Changes

All improvements are 100% backward compatible:

  • βœ… Existing Apify Actors work unchanged
  • βœ… Claude MCP integration unchanged
  • βœ… Gradio UI unchanged
  • βœ… No migration required

πŸ“ License

MIT

πŸ‘€ Author

T0X1N


For detailed component documentation, see individual README files in each directory.

About

πŸ“š Turn Medium articles into audio, summaries, and AI reports. Features robust scraping with anti-bot bypass, Claude Desktop (MCP) integration, and a Gradio UI.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors