Skip to content

Release v0.4.0#4

Merged
pikulev merged 19 commits intomainfrom
release-v0.4.0
Jun 14, 2025
Merged

Release v0.4.0#4
pikulev merged 19 commits intomainfrom
release-v0.4.0

Conversation

@pikulev
Copy link
Owner

@pikulev pikulev commented Jun 14, 2025

Changelog

v0.4.0

  • BREAKING: The old flatten (which stringifies nested structures) is now called stringify.
  • BREAKING: The new flatten has different behavior—please update your code if you relied on the old flatten logic.
  • BREAKING: Pipeline now requires a list of transformers and a PipelineConfig instance (no more id_fn/id_field in constructor).
  • BREAKING: Pipeline.process now expects a list of dicts (e.g., from HarLog.model_dump()["entries"]).
  • New: Introduced a new flatten transformer that fully flattens nested HAR entries into a flat dict, with customizable key separator and flexible array handling via array_handler. Designed for advanced analytics and BI.
  • New: PipelineConfig class for configuring batch size, processing strategy (sequential/thread/process/async), and max_workers.
  • New: Parallel and batch processing strategies for large HAR files (process, thread, async).
  • New: Benchmarks and benchmarking scripts for pipeline performance (see benchmarks/).
  • New: All transformers (flatten, normalize_sizes, normalize_timings, set_id) are now implemented as picklable callable classes, fully compatible with multiprocessing.
  • New: set_id transformer for assigning IDs to entries using any function (e.g., by_field, uuid).
  • Internal: Test suite and samples updated for new API and real-world HAR compatibility.

@codecov-commenter
Copy link

⚠️ Please install the 'codecov app svg image' to ensure uploads and comments are reliably processed by Codecov.

Codecov Report

Attention: Patch coverage is 99.64413% with 1 line in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
tests/conftest.py 93.75% 1 Missing ⚠️

📢 Thoughts on this report? Let us know!

@pikulev pikulev marked this pull request as ready for review June 14, 2025 10:01
@pikulev pikulev merged commit c13de58 into main Jun 14, 2025
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants