Commit Graph

148 Commits

Author SHA1 Message Date
Kenny Daniel
7a08aa3183
Handle repeated with no children 2024-05-23 18:26:16 -07:00
Kenny Daniel
ed3b525a27
Fix nested optional from duckdb#3734 🦆 2024-05-23 18:19:01 -07:00
Kenny Daniel
af7bab33f8
Handle top level repeated from duckdb#2557 🦆 2024-05-23 17:43:36 -07:00
Kenny Daniel
d92cc5fd22
Convert timestamps and json 2024-05-23 16:43:26 -07:00
Kenny Daniel
06578a9419
struct_strings.parquet 2024-05-23 02:10:04 -07:00
Kenny Daniel
7d1d877c9f
Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
Kenny Daniel
b8e4496063
Upgrade dataPage to match dictionary type 2024-05-23 00:07:09 -07:00
Kenny Daniel
c4ad05e580
Convert byte arrays to utf8 by default 2024-05-22 22:40:21 -07:00
Kenny Daniel
1f8289b4b2
rle_boolean_encoding.parquet 2024-05-22 19:16:10 -07:00
Kenny Daniel
9369faad46
Code cleanup 🧹 2024-05-22 12:58:37 -07:00
Kenny Daniel
5eeb05da40
dict-page-offset-zero.parquet 2024-05-21 22:50:50 -07:00
Kenny Daniel
4f7791354c
incorrect_map_schema.parquet 2024-05-21 22:18:39 -07:00
Kenny Daniel
6a75a960da
Convert boolean column 2024-05-21 22:05:29 -07:00
Kenny Daniel
66b832d5bb
Fix RLE encoding length 2024-05-21 18:41:57 -07:00
Kenny Daniel
a1ca1ef785
byte_stream_split_extended.gzip.parquet 2024-05-21 17:21:36 -07:00
Kenny Daniel
70387fa345
repeated_no_annotation.parquet 2024-05-20 23:09:31 -07:00
Kenny Daniel
d453313dca
Fix optional structs! 2024-05-20 05:03:33 -07:00
Kenny Daniel
9cd09b8eed
Byte stream split encoding 2024-05-20 04:09:32 -07:00
Kenny Daniel
1689d7473a
Delta length byte array encoding 2024-05-20 02:32:31 -07:00
Kenny Daniel
d4341b803e
Delta byte array encoding 2024-05-18 19:23:11 -07:00
Kenny Daniel
48d79e6a1d
Move deltaBinaryUnpack to delta.js and always consume miniblock 2024-05-18 18:57:17 -07:00
Kenny Daniel
f389e30565
Remove unnecessary parens 2024-05-18 18:26:52 -07:00
Kenny
cf4c4ba04d
Assembly of nested column types (#11) 2024-05-17 22:44:03 -07:00
Kenny Daniel
3f958ed25d
Handle skipNulls in assembleLists 2024-05-17 19:41:40 -07:00
Kenny Daniel
034e9cda16
Faster row transpose 2024-05-14 17:13:24 -07:00
Kenny Daniel
9f95eff222
Faster decimal conversion 2024-05-14 01:58:28 -07:00
Kenny Daniel
c83aa2ea5b
Float16 2024-05-13 20:36:53 -07:00
Kenny Daniel
7ae1f88047
Allow zero-width rle 2024-05-13 00:29:16 -07:00
Kenny Daniel
7639b8ca7f
Fix fixed length byte array type 2024-05-12 21:52:26 -07:00
Kenny Daniel
bd4e7c1699
Actually fix conversion of decimals 2024-05-12 20:53:28 -07:00
Kenny Daniel
fe7e19b2a4
Fix decimal conversion with precision 2024-05-12 19:52:15 -07:00
Kenny Daniel
e064efc66c
Int96 date parsing 2024-05-12 19:24:10 -07:00
Kenny Daniel
82db6a8017
Delta binary packed encoding 2024-05-12 15:47:16 -07:00
Kenny Daniel
4d960e0533
Convert consistently 2024-05-09 17:07:05 -07:00
Kenny Daniel
e398e66dd4
No utf8 in plain decoding 2024-05-09 16:28:50 -07:00
Kenny Daniel
5291ff1072
Use .set in case of unaligned read 2024-05-09 16:22:44 -07:00
Kenny Daniel
797db7b4df
Simplify isListLike and isMapLike 2024-05-06 13:33:39 -07:00
Kenny Daniel
12dc5a47f8
Add path to schemaTree 2024-05-06 13:23:18 -07:00
Kenny Daniel
892c933a05
Parse logical types 2024-05-05 16:13:19 -07:00
Kenny Daniel
57ed66646d
Convert statistics based on column type 2024-05-04 01:11:46 -07:00
Kenny Daniel
3d5d423694
Parse additional metadata 2024-05-04 01:03:42 -07:00
Kenny Daniel
eabf62f5a1
Return Uint8Array from thrift 2024-05-04 00:47:24 -07:00
Kenny Daniel
f86c8c6359
Update metadata types based on parquet.thrift schema, use bigint for i64 type. 2024-05-04 00:18:16 -07:00
Kenny Daniel
f411b83f5e
Fix min/max type definition 2024-05-02 17:29:39 -07:00
Kenny Daniel
bded3fb331
Encoding tests 2024-05-02 17:21:17 -07:00
Kenny Daniel
4d5c8324aa
TypedArrays 2024-05-01 23:23:55 -07:00
Kenny Daniel
d093b0dcaa
Use DataReader for thrift 2024-05-01 00:55:16 -07:00
Kenny Daniel
b8660baea1
Split out plain encoding 2024-04-30 20:28:50 -07:00
Kenny Daniel
af908b9b83
No copy readBitPacked 2024-04-30 19:59:58 -07:00
Kenny Daniel
3deab62000
No copy readRle 2024-04-30 17:30:08 -07:00