Archive deprecated directories to data/ATTIC/ #107
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Comprehensive repository cleanup - consolidated legacy data structures into organized ATTIC archive to improve repository clarity and maintainability. ## Changes ### Archived Directories (~29 MB) **From repository root → data/ATTIC/root_downloads/:** - downloads_by_column_enhanced/ (14 MB) - downloads_by_column_combined/ (912 KB) - downloads_by_column_enhanced_combined/ (620 KB) - test_downloads/ (4.0 MB) - old/ (9.1 MB) **From data/ → data/ATTIC/:** - sheets_concatenated/ (84 KB) - validated_extracted/ → validated_extracted_html_only/ (132 KB) ### Documentation **Created:** - data/ATTIC/README.md - Comprehensive 500+ line guide documenting: - Directory organization with size breakdown - Migration timeline and rationale (Dec 19, 2024) - Current vs deprecated pipeline comparison - Archive retention guidance - Low-priority cleanup action items **Updated:** - CLAUDE.md - Added ATTIC structure to Data Organization section - CLAUDE.md - Added Important Note about legacy data archival ### Verification Performed ✅ GitHub Actions workflows - No references to deprecated dirs ✅ Claude Code agents - No active references ✅ Makefiles - No active usage (only example comments) ✅ Source code - No breakage (overridden defaults) ✅ Documentation - No breaking references⚠️ PRESERVED utils/ - Actively used by d4d_to_synapse_table.yml workflow ### Testing ✅ Schema validation passes (make test-schema) ✅ Python unit tests pass (6 tests OK, 3 skipped) ✅ Repository state verified ## Impact - **Root directory**: 5 deprecated directories removed - **Data organization**: Active pipeline + organized ATTIC archive - **Documentation**: Clear migration path and historical reference - **No breaking changes**: All active paths preserved - **Total archived**: ~29 MB from this cleanup + existing ATTIC content ## Context After establishing the current D4D pipeline (claudecode_agent as canonical method) and standardizing all paths, these legacy directories from earlier extraction experiments were consolidated into data/ATTIC/ for historical reference. See data/ATTIC/README.md for complete archival documentation and timeline. Related: Plan mode directory cleanup analysis
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Comprehensive repository cleanup - consolidated legacy data structures into organized ATTIC archive to improve repository clarity and maintainability.
Changes
Archived Directories (~29 MB)
From repository root → data/ATTIC/root_downloads/:
From data/ → data/ATTIC/:
Documentation
Created:
Updated:
Verification Performed
✅ GitHub Actions workflows - No references to deprecated dirs ✅ Claude Code agents - No active references
⚠️ PRESERVED utils/ - Actively used by d4d_to_synapse_table.yml workflow
✅ Makefiles - No active usage (only example comments) ✅ Source code - No breakage (overridden defaults)
✅ Documentation - No breaking references
Testing
✅ Schema validation passes (make test-schema)
✅ Python unit tests pass (6 tests OK, 3 skipped)
✅ Repository state verified
Impact
Context
After establishing the current D4D pipeline (claudecode_agent as canonical method) and standardizing all paths, these legacy directories from earlier extraction experiments were consolidated into data/ATTIC/ for historical reference.
See data/ATTIC/README.md for complete archival documentation and timeline.
Related: Plan mode directory cleanup analysis