Skip to content

Releases: apicrafter/datacrafter

Release v1.0.4: Major Code Quality Improvements

09 Dec 09:54
@ivbeg ivbeg
v1.0.4
7301492

Choose a tag to compare

View all tags
Release v1.0.4: Major Code Quality Improvements Latest
Latest

Release v1.0.4 - 2025-12-09

Fixed

  • Code Quality Improvements: Comprehensive pylint-based code quality improvements
    • Fixed all critical errors (E): Import errors for optional dependencies (xmltodict, apibackuper)
    • Fixed all abstract method warnings (W0223): Implemented missing abstract methods in BaseFileDestination and BaseFileSource
    • Fixed all unused import/argument warnings (W0611, W0613): Removed unused imports and prefixed unused arguments with _
    • Fixed variable naming issues (C0103): Renamed short exception variables (e → error, f → file_obj, r → record)
    • Fixed line length violations (C0301): Reformatted long lines, function signatures, and dictionary/list definitions
    • Improved error handling: Better exception variable naming throughout the codebase
    • Code quality score improved from 6.42/10 to 9.12/10 (+42% improvement)
    • Total issues reduced from 677 to 171 (75% reduction)

Changed

  • Improved code maintainability and readability
  • Better error messages with properly named exception variables
  • Enhanced code consistency across the codebase

Documentation

  • Added code quality recommendations documentation (notes/CODE_QUALITY_RECOMMENDATIONS.md)
  • Added code quality summary (notes/CODE_QUALITY_SUMMARY.md)

See CHANGELOG.md for full details.

Assets 2
Loading

Release v1.0.3

08 Dec 17:43
@ivbeg ivbeg
v1.0.3
55e4b5a

Choose a tag to compare

View all tags
Release v1.0.3

What's New in v1.0.3

Added

  • Zstandard (zst) compression support for sources and destinations
  • Support for both compress and compression configuration keys for backward compatibility
  • Comprehensive documentation updates
  • Configuration validation command (datacrafter config validate)
  • Configuration schema command (datacrafter config schema)
  • Improved error handling and validation
  • Support for structured JSON logging
  • Quiet mode for reduced output
  • Status command to check pipeline execution state
  • Log command to view execution logs
  • Check command for configuration and environment validation
  • Compression examples and test coverage

Fixed

  • Dependency management: Synchronized dependencies between setup.py and requirements.txt
  • Added missing dictquery dependency to requirements
  • Created requirements-pinned.txt for production builds
  • Created DEPENDENCIES.md documentation
  • Improved logging configuration (default to INFO level)
  • Better error messages with actionable suggestions
  • Compression configuration now supports both compress and compression keys

Changed

  • Default logging level changed from DEBUG to INFO
  • Improved CLI structure and organization
  • Enhanced configuration validation
  • Better error handling throughout the codebase

Documentation

  • Updated README.md with comprehensive installation and usage instructions
  • Added command reference section
  • Added configuration examples
  • Created DEPENDENCIES.md for dependency management
  • Improved project documentation structure
  • Added compression examples demonstrating zst support
Loading