Data loss when parsing Char compressed sas7bdat file

[skygon]

Hi,
We have a char-compressed sas7bdat file which should have 98366 rows. But when use parso to read this file, we only get 90536 rows. The original uncompressed file works fine, all rows can be successfully parsed.
The schema of this file seems normal, about 30 columns with number, date and string types.

Any suggestion about this issue? Thanks

[printsev]

Hi,

Would it be possible for you to share this file with us? Are you using the latest version (2.0.8)?

[skygon]

sas.zip

[skygon]

@printsev Hi, sas file uploaded. Would you please help to take a further look? Thanks.

[printsev]

We are looking into this issue, looks like the issue is with writer, not with parso reader - you can use this as a workaround.