Commit Graph

92 Commits

Author SHA1 Message Date
Kenny Daniel
a42cc558d0
Adjust read coalesce size 2024-04-29 16:43:07 -07:00
Kenny Daniel
54ef1e6b0a
Rewrite dremel assembly 2024-04-28 19:03:39 -07:00
Kenny Daniel
bf1b8d79c7
Simplify imports 2024-04-28 16:05:47 -07:00
Kenny Daniel
09ea11517c
Fix typescript definitions 2024-04-26 14:01:00 -07:00
Kenny Daniel
86273b110c
PageType enum to string 2024-04-18 00:21:13 -07:00
Kenny Daniel
f826bff757
Use DataReader over Decoded. Fewer allocations, slightly faster. 2024-04-17 23:43:04 -07:00
Kenny Daniel
4b7d864319
Error handling for missing byteLength 2024-04-17 17:48:35 -07:00
Kenny Daniel
00cbb6a3e6
Fix rowStart in onChunk callback.
Also split out readFiles tests.
2024-04-12 23:34:56 -07:00
Kenny Daniel
dd91122753
Update README with example for Async and Row/Column filtering 2024-04-11 13:11:58 -07:00
Kenny Daniel
6ffdeca103
Fast array concat 2024-04-07 09:59:37 -07:00
Kenny Daniel
429fd9e813
Fix max call stack error in browser: concat not spread... 2024-04-06 22:01:42 -07:00
Kenny Daniel
48dc10fd18
Error handling for undefined parquet file 2024-04-05 11:11:39 -07:00
Kenny Daniel
d8d453421c
Fix dremel assembly 2024-03-29 17:39:16 -07:00
Kenny Daniel
46df1ab454
Rewrite dremel assembly 2024-03-21 16:47:21 -07:00
Kenny Daniel
b0d653f342
Undefined int map 2024-03-19 09:09:15 -07:00
Kenny Daniel
52721a3d30
Split out assemble objects 2024-03-18 17:40:52 -07:00
Kenny Daniel
4654c5eddf
Fix tests 2024-03-15 00:17:35 -07:00
Kenny Daniel
b14809a71a
Fix struct map parsing 2024-03-14 19:53:56 -07:00
Kenny Daniel
76c4278f40
List-like column names 2024-03-14 19:38:04 -07:00
Kenny Daniel
2d061392b9
Column filter by name 2024-03-14 18:04:04 -07:00
Kenny Daniel
c6ad30b59a
schemaElement returns trees 2024-03-12 20:39:15 -07:00
Kenny Daniel
8a98407734
Parse logical types from metadata 2024-03-12 01:15:12 -07:00
Kenny Daniel
0f4708b954
Change compressors to return Uint8Array 2024-02-27 19:45:56 -08:00
Kenny Daniel
319dbb124e
Hysnappy wasm for faster benchmark.js 2024-02-27 14:37:32 -08:00
Kenny Daniel
8b575ad2d8
ParquetType as string 2024-02-27 11:31:17 -08:00
Kenny Daniel
11f35c9e43
Encoding as string 2024-02-27 10:51:57 -08:00
Kenny Daniel
e3b5fca883
Custom decompressors 2024-02-27 09:05:02 -08:00
Kenny Daniel
ea3d1a8bbb
Fix alltypes_tiny_pages_plain.parquet 2024-02-26 23:26:29 -08:00
Kenny Daniel
87d78ab06e
Oops fix the other tests 2024-02-26 22:51:57 -08:00
Kenny Daniel
5147dbe709
Publish v0.4.0 2024-02-26 19:16:39 -08:00
Kenny Daniel
a65132b79c
Data Page V2 2024-02-26 18:44:33 -08:00
Kenny Daniel
ca971ccc01
Split out convert function 2024-02-26 12:20:48 -08:00
Kenny Daniel
c70b3b2227
Prepare for data page v2 2024-02-26 11:44:28 -08:00
Kenny Daniel
a7e5aef31f
decompressPage for dictionary and data page v1 only 2024-02-24 12:12:38 -08:00
Kenny Daniel
ada7429685
Prepare for alternate decompressors 2024-02-21 13:44:12 -08:00
Kenny Daniel
e2b85304b3
Fix UTF8 decoding 2024-02-16 16:27:00 -08:00
Kenny Daniel
d02c68e883
Fix isRequired and add parquet-testing impala test 2024-02-16 16:07:09 -08:00
Kenny Daniel
5f4e2ffe59
parquet-testing byte_array_decimal 2024-02-13 22:05:37 -08:00
Kenny Daniel
054431c98e
Test read of all sample files 2024-02-13 21:12:11 -08:00
Kenny Daniel
9b37885c7c
Handle int64 decimal 2024-02-11 21:45:35 -08:00
Kenny Daniel
7f63a92679
Handle conversion of decimal byte array 2024-02-11 21:35:07 -08:00
Kenny Daniel
69d2e725dd
Fix plain_dictionary encoding 2024-02-11 20:45:53 -08:00
Kenny Daniel
8f7cd07734
Human readable metadata types 2024-02-11 15:22:52 -08:00
Kenny Daniel
17f7ace840
Fix bug in readData, support more parquet files 2024-02-11 14:27:38 -08:00
Kenny Daniel
961b92650c
Never copy data 2024-02-09 14:35:11 -08:00
Kenny Daniel
2e11ab275d
Perf benchmark 2024-02-07 11:54:53 -08:00
Kenny Daniel
7902142712
Demo from URL 2024-02-04 23:29:20 -08:00
Kenny Daniel
5623b67ad5
Check for magic number before reading metadata length.
Also make sure that metadata length is available.
2024-02-02 12:59:13 -08:00
Kenny Daniel
42ce3b94df
Better error for unsupported compressor 2024-02-01 23:54:15 -08:00
Kenny Daniel
800b39b575
Fix initial fetch size larger > file size 2024-02-01 23:28:36 -08:00