Commit Graph

63 Commits

Author SHA1 Message Date
Kenny Daniel
5147dbe709
Publish v0.4.0 2024-02-26 19:16:39 -08:00
Kenny Daniel
a65132b79c
Data Page V2 2024-02-26 18:44:33 -08:00
Kenny Daniel
ca971ccc01
Split out convert function 2024-02-26 12:20:48 -08:00
Kenny Daniel
c70b3b2227
Prepare for data page v2 2024-02-26 11:44:28 -08:00
Kenny Daniel
a7e5aef31f
decompressPage for dictionary and data page v1 only 2024-02-24 12:12:38 -08:00
Kenny Daniel
ada7429685
Prepare for alternate decompressors 2024-02-21 13:44:12 -08:00
Kenny Daniel
e2b85304b3
Fix UTF8 decoding 2024-02-16 16:27:00 -08:00
Kenny Daniel
d02c68e883
Fix isRequired and add parquet-testing impala test 2024-02-16 16:07:09 -08:00
Kenny Daniel
5f4e2ffe59
parquet-testing byte_array_decimal 2024-02-13 22:05:37 -08:00
Kenny Daniel
054431c98e
Test read of all sample files 2024-02-13 21:12:11 -08:00
Kenny Daniel
9b37885c7c
Handle int64 decimal 2024-02-11 21:45:35 -08:00
Kenny Daniel
7f63a92679
Handle conversion of decimal byte array 2024-02-11 21:35:07 -08:00
Kenny Daniel
69d2e725dd
Fix plain_dictionary encoding 2024-02-11 20:45:53 -08:00
Kenny Daniel
8f7cd07734
Human readable metadata types 2024-02-11 15:22:52 -08:00
Kenny Daniel
17f7ace840
Fix bug in readData, support more parquet files 2024-02-11 14:27:38 -08:00
Kenny Daniel
961b92650c
Never copy data 2024-02-09 14:35:11 -08:00
Kenny Daniel
2e11ab275d
Perf benchmark 2024-02-07 11:54:53 -08:00
Kenny Daniel
7902142712
Demo from URL 2024-02-04 23:29:20 -08:00
Kenny Daniel
5623b67ad5
Check for magic number before reading metadata length.
Also make sure that metadata length is available.
2024-02-02 12:59:13 -08:00
Kenny Daniel
42ce3b94df
Better error for unsupported compressor 2024-02-01 23:54:15 -08:00
Kenny Daniel
800b39b575
Fix initial fetch size larger > file size 2024-02-01 23:28:36 -08:00
Kenny Daniel
07f3a55695
Fix string conversion with a dictionary 2024-01-28 00:08:36 -08:00
Kenny Daniel
619f790795
Convert rich types 2024-01-20 18:30:10 -08:00
Kenny Daniel
6d03bd6d86
Fix definition level parsing 2024-01-20 18:18:32 -08:00
Kenny Daniel
a40e678214
Fix parquetSchema type 2024-01-20 10:03:18 -08:00
Kenny Daniel
8d7b145439
Export parquetSchema tree 2024-01-19 21:23:32 -08:00
Kenny Daniel
647056da8b
Async parquetRead with options 2024-01-15 15:11:03 -08:00
Kenny Daniel
d7e98766ab
AsyncBuffer oops wrong type 2024-01-15 13:52:31 -08:00
Kenny Daniel
c2b48ab2fe
parquetMetadataAsync tests 2024-01-15 13:40:12 -08:00
Kenny Daniel
be7f2a8c77
Async metadata fetching 2024-01-15 12:30:35 -08:00
Kenny Daniel
1da38f040d
Fix over-eager column validation 2024-01-15 12:08:28 -08:00
Kenny Daniel
a5a9824715
Encoding readRleBitPackedHybrid tests 2024-01-14 19:43:49 -08:00
Kenny Daniel
00a8dbf57f
Schema util tests 2024-01-14 15:36:58 -08:00
Kenny Daniel
060ef950b2
offsetArrayBuffer to return an offset view of an array buffer 2024-01-14 13:38:05 -08:00
Kenny Daniel
4708ffca2f
Factor out getColumnOffset 2024-01-14 11:14:04 -08:00
Kenny Daniel
6ca1d2a85c
Consistent parquet error messages 2024-01-12 17:54:42 -08:00
Kenny Daniel
03727d0156
Include metadata length in metadata 2024-01-12 14:36:50 -08:00
Kenny Daniel
62632d9333
Metadata test rowgroups.parquet 2024-01-11 11:10:36 -08:00
Kenny Daniel
58aed8d9cd
Update README 2024-01-09 15:15:08 -08:00
Kenny Daniel
955a5f0653
Parquet column parser 2024-01-07 17:04:05 -08:00
Kenny Daniel
c384cf469b
Parquet data page parser 2024-01-07 15:33:24 -08:00
Kenny Daniel
efdaf2ce27
Parquet schema utils 2024-01-06 20:28:29 -08:00
Kenny Daniel
37e981fa13
Publish v0.1.1 2024-01-05 14:37:19 -08:00
Kenny Daniel
92902c41d3
Parquet header parser 2024-01-05 03:08:42 -08:00
Kenny Daniel
be7085c1a6
Parquet encoding 2024-01-05 02:16:15 -08:00
Kenny Daniel
954671f810
Export toJson 2024-01-05 01:39:59 -08:00
Kenny Daniel
02c25051f2
Export snappyUncompress 2024-01-04 11:45:37 -08:00
Kenny Daniel
04bfd474b8
All javascript, no typescript 2024-01-04 11:11:00 -08:00
Kenny Daniel
769876a8af
Metadata TS to JS 2024-01-04 10:36:29 -08:00
Kenny Daniel
754b6eca04
Thrift TS to JS 2024-01-04 10:26:34 -08:00