Facing count difference in read and write

[chhokarpardeep]

I'm getting count difference from the source to target CSV. Please check below details:

./sas-convert/sas-convert xpnt_ptrk_dtl_wk_cho.sas7bdat xpnt_ptrk_dtl_wk_cho.csv
2017-04-11 23:58:03,321 [INFO] Reading file XPNT_PTRK_DTL_WK_CHO
2017-04-11 23:58:03,324 [INFO] 410452665 rows.
2017-04-11 23:58:03,324 [INFO] Writing data...
2017-04-12 00:42:02,643 [INFO] Done writing data.
2017-04-12 00:42:02,643 [INFO] 356176390 rows written.
2017-04-12 00:42:02,644 [INFO] Converting took 2639 seconds.

It read 410452665 rows from the header information and Writed 356176390 records to CSV. Please help me to identify the issue or suggest is this fine.

[gijskant]

When I test it on a test file from the CDC, I get the same number of rows for reading and writing.
For instance, for the sample data set calcmilk.sas7bdat, I get:

$ ./sas-convert calcmilk.sas7bdat calcmilk.csv 
2017-04-18 09:57:31,687 [INFO] Reading file CALCMILK
2017-04-18 09:57:31,689 [INFO] 10122 rows.
2017-04-18 09:57:31,689 [INFO] Writing data...
2017-04-18 09:57:31,814 [INFO] Done writing data.
2017-04-18 09:57:31,814 [INFO] 10122 rows written.
2017-04-18 09:57:31,814 [INFO] Converting took 0 seconds.

The reported read count is the one reported by the Parso library as the read count in the sas-file, the write count is the number of rows actually read and written.
Count you send an example file for which this issue occurs?

[chhokarpardeep]

File size is 54 GB. Not able to download from client server. It's working fine with others files.