Compression module#1455

Open

mariliatd wants to merge 12 commits intoonline-ml:mainfrom

ayameira:compression-module

Commits on Nov 19, 2023

feat(py): Initialize text classification module with compression algorithm

ayameira
authored and
mariliatd
committed
change zstd library and ajust code
mariliatd
committed
fix trim trailing whitespace and mixed line ending
mariliatd
committed
fix learn_one by saving compressor context
mariliatd
committed
docs(py) add comment to the predict_one method and add test script

ayameira
authored and
mariliatd
committed
feat(py) add sliding window of observed documents by receiving an integer k as parameter

ayameira
authored and
mariliatd
committed
docs(classifier): add docstrings for TextCompressionClassifier

ayameira
authored and
mariliatd
committed
feat(tests): integrate TextCompression module to test routine test_estimators.py

ayameira
authored and
mariliatd
committed
fix(text-compression) adding __getstate__ and __setstate__ methods in order to be able to pickle the text compression model (ZstdCompressor can't be pickled).

ayameira
authored and
mariliatd
committed
fix(text-compression) adding k to the getstate and setstate methods

ayameira
authored and
mariliatd
committed
fix(text-compression) Skipping shuffling unit testing

ayameira
authored and
mariliatd
committed
add zstandard library to dependencies
mariliatd
committed