Commit Graph

107 Commits

Author SHA1 Message Date
Kenny Daniel
eabf62f5a1
Return Uint8Array from thrift 2024-05-04 00:47:24 -07:00
Kenny Daniel
f86c8c6359
Update metadata types based on parquet.thrift schema, use bigint for i64 type. 2024-05-04 00:18:16 -07:00
Kenny Daniel
f411b83f5e
Fix min/max type definition 2024-05-02 17:29:39 -07:00
Kenny Daniel
bded3fb331
Encoding tests 2024-05-02 17:21:17 -07:00
Kenny Daniel
4d5c8324aa
TypedArrays 2024-05-01 23:23:55 -07:00
Kenny Daniel
d093b0dcaa
Use DataReader for thrift 2024-05-01 00:55:16 -07:00
Kenny Daniel
b8660baea1
Split out plain encoding 2024-04-30 20:28:50 -07:00
Kenny Daniel
af908b9b83
No copy readBitPacked 2024-04-30 19:59:58 -07:00
Kenny Daniel
3deab62000
No copy readRle 2024-04-30 17:30:08 -07:00
Kenny Daniel
f16e23f501
No copy readRleBitPackedHybrid 2024-04-30 14:40:18 -07:00
Kenny Daniel
195ee9bc80
Splice into fixed length array 2024-04-30 13:43:01 -07:00
Kenny Daniel
488bfa7f90
Preallocate arrays for faster decoding 2024-04-30 00:38:19 -07:00
Kenny Daniel
93ff9a9f99
Refactor isListLike and isMapLike to use schemaPath 2024-04-29 18:45:29 -07:00
Kenny Daniel
2c6a111113
Refactor to use schemaPath 2024-04-29 17:38:26 -07:00
Kenny Daniel
6ebb6a9ee8
isListLike and isMapLike tests 2024-04-29 17:16:47 -07:00
Kenny Daniel
a42cc558d0
Adjust read coalesce size 2024-04-29 16:43:07 -07:00
Kenny Daniel
54ef1e6b0a
Rewrite dremel assembly 2024-04-28 19:03:39 -07:00
Kenny Daniel
bf1b8d79c7
Simplify imports 2024-04-28 16:05:47 -07:00
Kenny Daniel
09ea11517c
Fix typescript definitions 2024-04-26 14:01:00 -07:00
Kenny Daniel
86273b110c
PageType enum to string 2024-04-18 00:21:13 -07:00
Kenny Daniel
f826bff757
Use DataReader over Decoded. Fewer allocations, slightly faster. 2024-04-17 23:43:04 -07:00
Kenny Daniel
4b7d864319
Error handling for missing byteLength 2024-04-17 17:48:35 -07:00
Kenny Daniel
00cbb6a3e6
Fix rowStart in onChunk callback.
Also split out readFiles tests.
2024-04-12 23:34:56 -07:00
Kenny Daniel
dd91122753
Update README with example for Async and Row/Column filtering 2024-04-11 13:11:58 -07:00
Kenny Daniel
6ffdeca103
Fast array concat 2024-04-07 09:59:37 -07:00
Kenny Daniel
429fd9e813
Fix max call stack error in browser: concat not spread... 2024-04-06 22:01:42 -07:00
Kenny Daniel
48dc10fd18
Error handling for undefined parquet file 2024-04-05 11:11:39 -07:00
Kenny Daniel
d8d453421c
Fix dremel assembly 2024-03-29 17:39:16 -07:00
Kenny Daniel
46df1ab454
Rewrite dremel assembly 2024-03-21 16:47:21 -07:00
Kenny Daniel
b0d653f342
Undefined int map 2024-03-19 09:09:15 -07:00
Kenny Daniel
52721a3d30
Split out assemble objects 2024-03-18 17:40:52 -07:00
Kenny Daniel
4654c5eddf
Fix tests 2024-03-15 00:17:35 -07:00
Kenny Daniel
b14809a71a
Fix struct map parsing 2024-03-14 19:53:56 -07:00
Kenny Daniel
76c4278f40
List-like column names 2024-03-14 19:38:04 -07:00
Kenny Daniel
2d061392b9
Column filter by name 2024-03-14 18:04:04 -07:00
Kenny Daniel
c6ad30b59a
schemaElement returns trees 2024-03-12 20:39:15 -07:00
Kenny Daniel
8a98407734
Parse logical types from metadata 2024-03-12 01:15:12 -07:00
Kenny Daniel
0f4708b954
Change compressors to return Uint8Array 2024-02-27 19:45:56 -08:00
Kenny Daniel
319dbb124e
Hysnappy wasm for faster benchmark.js 2024-02-27 14:37:32 -08:00
Kenny Daniel
8b575ad2d8
ParquetType as string 2024-02-27 11:31:17 -08:00
Kenny Daniel
11f35c9e43
Encoding as string 2024-02-27 10:51:57 -08:00
Kenny Daniel
e3b5fca883
Custom decompressors 2024-02-27 09:05:02 -08:00
Kenny Daniel
ea3d1a8bbb
Fix alltypes_tiny_pages_plain.parquet 2024-02-26 23:26:29 -08:00
Kenny Daniel
87d78ab06e
Oops fix the other tests 2024-02-26 22:51:57 -08:00
Kenny Daniel
5147dbe709
Publish v0.4.0 2024-02-26 19:16:39 -08:00
Kenny Daniel
a65132b79c
Data Page V2 2024-02-26 18:44:33 -08:00
Kenny Daniel
ca971ccc01
Split out convert function 2024-02-26 12:20:48 -08:00
Kenny Daniel
c70b3b2227
Prepare for data page v2 2024-02-26 11:44:28 -08:00
Kenny Daniel
a7e5aef31f
decompressPage for dictionary and data page v1 only 2024-02-24 12:12:38 -08:00
Kenny Daniel
ada7429685
Prepare for alternate decompressors 2024-02-21 13:44:12 -08:00