fix: examples accuracy, export stalling, missing images, third-party asset filtering

Docs & examples:
- Fix install instructions (not on PyPI, use git clone + local install)
- Fix invalid format name markdown-github -> html,md
- Fix placeholder URLs (your-org -> 19-84, security@example.com)
- Fix EXPORT_FORMATS docs to use valid names (html, md, hybrid)
- Remove 9 deadwood config options ([export.html/markdown/github])

Docker:
- Dockerfiles now pip install the package (not bare deps)
- Fix healthcheck to use python -m chronicon.cli
- Fix postgres compose: API volume not read-only, watch gets external network
- Fix double entrypoint in postgres compose usage comment
- Remove deprecated version key and duplicate restart in prod compose

Export stalling:
- Add iter_topics_batched() to database layer for paginated iteration
- Rewrite search indexer to stream JSON to disk (single pass, no list accumulation)
- Fix SEO context to use current page posts instead of loading all
- Sitemap writes directly to file instead of building in-memory list
- HTML and markdown exporters use batched topic iteration

Missing images:
- Extract data-src/data-original attributes (Discourse lazy loading)
- Fix emoji URL filter (class="emoji" is sufficient, don't require "emoji" in path)
- Normalize protocol-relative URLs (//domain) to https:// everywhere
- Fix lightbox URL extraction doubling domain on // URLs
- Log download failures with URL and error type
- Handle filename collisions with hash suffix
- Fix Tier 3 fallback: exact filename match instead of substring
- Fix Windows path separator in get_assets_for_topic()
- Remove bogus /images/favicon.ico and /images/logo.png fallback downloads
- Filter third-party URLs before downloading (only forum domain + CDN)
- Skip emoji class images in extract_image_sets (handled separately)

CLI:
- Add --base-url flag for canonical URL (was config-only)
- Add --timeout, --retry-max, --posts-per-page flags
- Wire timeout/retry into API client from config

Tests:
- Add test_search_indexer_streaming.py (10 tests)
- Add test_examples_accuracy.py (21 e2e tests for examples)
- Add data-src/data-original extraction tests
- Add protocol-relative URL tests
- Add iter_topics_batched and cross-platform path tests
- Update emoji filter and site asset tests for new behavior

Author: 19-84

.chronicon.toml.example

@@ -22,21 +22,6 @@ text_only = false
 # Leave commented out for offline-only archives
 # canonical_base_url = "https://example.github.io/forum-archive"
 
-[export.html]
-theme_adaptation = "simplified"  # simplified, full, minimal
-enable_search = true
-responsive = true
-
-[export.markdown]
-convert_html = true
-preserve_formatting = true
-include_metadata_header = true
-
-[export.github]
-generate_readme = true
-relative_image_paths = true
-gfm_syntax = true
-
 # Continuous mode settings
 [continuous]
 polling_interval_minutes = 10

Dockerfile

@@ -17,13 +17,14 @@ RUN apt-get update && apt-get install -y --no-install-recommends \
 RUN python3 -m venv /opt/venv
 ENV PATH="/opt/venv/bin:$PATH"
 
-# Copy only requirements first for caching
+# Copy project files for install
 WORKDIR /build
 COPY pyproject.toml ./
+COPY src/ ./src/
 
-# Install dependencies only (not the package itself)
+# Install package with all dependencies
 RUN pip install --no-cache-dir --upgrade pip setuptools wheel && \
-    pip install --no-cache-dir beautifulsoup4 html2text jinja2 rich
+    pip install --no-cache-dir .
 
 # Stage 2: Runtime stage (minimal)
 FROM python:3.12-slim
@@ -67,7 +68,7 @@ RUN chmod -R go-w /app 2>/dev/null || true
 
 # Health check
 HEALTHCHECK --interval=30s --timeout=5s --start-period=10s --retries=3 \
-    CMD chronicon validate --output-dir /archives || exit 1
+    CMD python -m chronicon.cli validate --output-dir /archives || exit 1
 
 # Labels for metadata
 LABEL maintainer="Chronicon" \

Dockerfile.alpine

@@ -16,13 +16,14 @@ RUN apk add --no-cache \
 RUN python3 -m venv /opt/venv
 ENV PATH="/opt/venv/bin:$PATH"
 
-# Copy only requirements first for caching
+# Copy project files for install
 WORKDIR /build
 COPY pyproject.toml ./
+COPY src/ ./src/
 
-# Install dependencies only (not the package itself)
+# Install package with all dependencies
 RUN pip install --no-cache-dir --upgrade pip setuptools wheel && \
-    pip install --no-cache-dir beautifulsoup4 html2text jinja2 rich
+    pip install --no-cache-dir .
 
 # Stage 2: Runtime stage (minimal)
 FROM python:3.12-alpine3.20
@@ -67,7 +68,7 @@ RUN chmod -R go-w /app 2>/dev/null || true
 
 # Health check (for validation/status commands)
 HEALTHCHECK --interval=30s --timeout=5s --start-period=10s --retries=3 \
-    CMD chronicon validate --output-dir /archives || exit 1
+    CMD python -m chronicon.cli validate --output-dir /archives || exit 1
 
 # Labels for metadata
 LABEL maintainer="Chronicon" \

README.md

@@ -32,17 +32,18 @@ If you find this useful, consider giving it a star on GitHub — it helps others
 ## Installation
 
 ```bash
-# Using uv (recommended)
-curl -LsSf https://astral.sh/uv/install.sh | sh
-uv tool install chronicon
+# Clone and install with uv (recommended)
+git clone https://github.com/19-84/chronicon.git
+cd chronicon
+uv sync --all-extras
 
-# Or with pip
-pip install chronicon
+# Or install with pip from source
+git clone https://github.com/19-84/chronicon.git
+cd chronicon
+pip install .
 
 # With PostgreSQL support (optional)
-pip install chronicon[postgres]
-# or
-uv tool install chronicon[postgres]
+pip install ".[postgres]"
 ```
 
 ## Quick Start

examples/README.md

@@ -15,7 +15,7 @@ chronicon archive \
   --urls https://meta.discourse.org \
   --categories 61 \
   --output-dir ./my-archive \
-  --formats html,markdown-github \
+  --formats html,md \
   --search-backend static
 
 # Export with canonical URLs for GitHub Pages

examples/docker/.env.postgres.example

@@ -3,7 +3,8 @@
 POSTGRES_PASSWORD=change_me_in_production
 
 # Export Formats
-# Options: html, markdown, html,markdown (hybrid)
+# Valid format names: html, md, hybrid
+# Comma-separate for multiple: html,md
 EXPORT_FORMATS=html
 
 # Git Push Integration (optional)

examples/docker/.env.sqlite.example

@@ -2,7 +2,8 @@
 # No database credentials needed — SQLite uses a local file at /archives/archive.db
 
 # Export Formats
-# Options: html, markdown, html,markdown (hybrid)
+# Valid format names: html, md, hybrid
+# Comma-separate for multiple: html,md
 EXPORT_FORMATS=html
 
 # Git Push Integration (optional)

examples/docker/Dockerfile.alpine

@@ -16,13 +16,14 @@ RUN apk add --no-cache \
 RUN python3 -m venv /opt/venv
 ENV PATH="/opt/venv/bin:$PATH"
 
-# Copy only requirements first for caching
+# Copy project files for install
 WORKDIR /build
 COPY pyproject.toml ./
+COPY src/ ./src/
 
-# Install dependencies only (not the package itself)
+# Install package with all dependencies
 RUN pip install --no-cache-dir --upgrade pip setuptools wheel && \
-    pip install --no-cache-dir beautifulsoup4 html2text jinja2 rich
+    pip install --no-cache-dir .
 
 # Stage 2: Runtime stage (minimal)
 FROM python:3.12-alpine3.20
@@ -67,7 +68,7 @@ RUN chmod -R go-w /app 2>/dev/null || true
 
 # Health check (for validation/status commands)
 HEALTHCHECK --interval=30s --timeout=5s --start-period=10s --retries=3 \
-    CMD chronicon validate --output-dir /archives || exit 1
+    CMD python -m chronicon.cli validate --output-dir /archives || exit 1
 
 # Labels for metadata
 LABEL maintainer="Chronicon" \

examples/docker/Dockerfile.alpine-watch

@@ -16,13 +16,14 @@ RUN apk add --no-cache \
 RUN python3 -m venv /opt/venv
 ENV PATH="/opt/venv/bin:$PATH"
 
-# Copy only requirements first for caching
+# Copy project files for install
 WORKDIR /build
 COPY pyproject.toml ./
+COPY src/ ./src/
 
-# Install dependencies only (not the package itself)
+# Install package with all dependencies
 RUN pip install --no-cache-dir --upgrade pip setuptools wheel && \
-    pip install --no-cache-dir beautifulsoup4 html2text jinja2 rich
+    pip install --no-cache-dir .
 
 # Stage 2: Runtime stage (minimal)
 FROM python:3.12-alpine3.20

examples/docker/README-ALPINE.md

@@ -461,12 +461,12 @@ docker-compose -f docker-compose.prod.yml up -d
 - Watch Mode: `../../WATCH_MODE.md`
 
 ### Issues
-Report security issues privately to: security@example.com
-Report bugs: https://github.com/your-org/chronicon/issues
+Report security issues privately: https://github.com/19-84/chronicon/security/advisories
+Report bugs: https://github.com/19-84/chronicon/issues
 
 ### Community
-- Discussions: https://github.com/your-org/chronicon/discussions
-- Discord: https://discord.gg/chronicon (if available)
+- Discussions: https://github.com/19-84/chronicon/discussions
+- Issues: https://github.com/19-84/chronicon/issues
 
 ## License