TDL-20219: Add support for JSONL files#40

Open

hpatel41 wants to merge 20 commits intocrest-masterfrom

TDL-20219-add-JSONL-support

Commits on Aug 18, 2022

added support for JSONL files
harshpatel4crest
committed
updated code
harshpatel4crest
committed

Commits on Aug 23, 2022

added utils for gzip to handle GZIP files and handled empty jsonl files
harshpatel4crest
committed

Commits on Aug 24, 2022

added unittests
harshpatel4crest
committed
added parameterized in config.yml
harshpatel4crest
committed
updated unittests
harshpatel4crest
committed
added test cases for row iterator function
harshpatel4crest
committed

Commits on Aug 25, 2022

updated code to skip gz file to no-name flag and handle max csv field width
harshpatel4crest
committed
added unittest and tap-tester
harshpatel4crest
committed
updated JSONL exception message
harshpatel4crest
committed

Commits on Aug 26, 2022

updated the code to not add sdc_extra if schema is empty
harshpatel4crest
committed

Commits on Aug 31, 2022

added sampling for list and dict
harshpatel4crest
committed

Commits on Sep 2, 2022

updated sampling logic for int and float
harshpatel4crest
committed

Commits on Sep 5, 2022

added tap-tester tests for JSONL and updated the code to start line count from 1 for JSONL files
harshpatel4crest
committed
added unittest for schema
harshpatel4crest
committed

Commits on Sep 6, 2022

updated jsonl tap-tester test
harshpatel4crest
committed

Commits on Sep 27, 2022

updated the code for JSONL to handle sampling logic on singer-encoding side
harshpatel4crest
committed
updated comments
harshpatel4crest
committed

Commits on Oct 11, 2022

resolve unittest failure
harshpatel4crest
committed
added comments for data generation function in base test file
harshpatel4crest
committed