Skip to content

Add integration tests with real RSS feeds #21

@guglielmo

Description

@guglielmo

Description

Create integration tests using real-world RSS feeds to validate end-to-end functionality and ensure compatibility with common feed formats.

Tasks

  • Create tests/integration/test_rss_integration.py
  • Test with real Hacker News RSS feed
  • Test with real blog feed (WordPress/Ghost)
  • Test with YouTube channel RSS
  • Test with Reddit subreddit RSS
  • Test mixed source list (HTML + RSS)
  • Verify token usage (RSS should use 0 Jina tokens)
  • Test content diff with RSS feeds
  • Test full sync workflow with RSS sources

Test Feeds

Use these well-known, stable feeds:

  • Hacker News: https://news.ycombinator.com/rss
  • Lobsters: https://lobste.rs/rss
  • Python Blog: https://blog.python.org/feeds/posts/default

Acceptance Criteria

  • All integration tests pass
  • RSS feeds fetch successfully
  • Content is properly stored
  • No Jina tokens consumed for RSS feeds
  • Sync progress updates correctly
  • Mixed HTML/RSS sources work together

Performance Validation

  • RSS feed fetch <2 seconds
  • Markdown conversion <100ms
  • Memory usage reasonable for 100+ entries

Estimate

Effort: 2 hours
Start Date: 2025-11-17
End Date: 2025-11-17

Dependencies

Related

Part of RSS Integration (Hybrid Approach) - Phase 3: Testing & Polish

Metadata

Metadata

Assignees

Labels

enhancementNew feature or request

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions