Skip to content

invalida page type reading example parquet #5

@dpnova

Description

@dpnova

Using this file:

https://github.com/Teradata/kylo/blob/master/samples/sample-data/parquet/userdata1.parquet

Have seen people having a similar issue with OG parquetjs: https://stackoverflow.com/questions/54988627/nodejs-javascript-typescript-error-while-reading-parquet-file

595 |         // cursor.offset += parquet_util.decodeThrift(pageHeader, cursor.buffer);
596 |         const { pageHeader, length } = Util.decodePageHeader(cursor.buffer);
597 |         cursor.offset += length;
598 |         const pageType = Util.getThriftEnum(thrift_1.PageType, pageHeader.type);
599 |         if (pageType !== 'DATA_PAGE_V2' && pageType !== 'DATA_PAGE') {
600 |             throw new Error(`Unsupported data page type ${pageType}`);
                      ^
error: Unsupported data page type DICTIONARY_PAGE
      at decodeDataPages (/home/dpn/workspace/datasets/node_modules/@dobesv/parquets/lib/reader.js:600:18)
      at decodeColumnChunk (/home/dpn/workspace/datasets/node_modules/@dobesv/parquets/lib/reader.js:572:11)
      at processTicksAndRejections (:55:76)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions