Kenny Daniel
d1d08d02bd
Throw exception for unsupported file_path
2025-05-03 20:38:04 -07:00
Kenny Daniel
ad1dd12990
Publish v1.13.0 with Parallel Fetch
2025-04-30 01:06:34 -07:00
Kenny Daniel
0e6d7dee6f
Parquet Query Planner: plan byte ranges, pre-fetch in parallel ( #75 )
...
* Parquet Query Planner: plan byte ranges, pre-fetch in parallel.
- parquetPlan() that returns lists of byte ranges to fetch.
- prefetchAsyncBuffer() pre-fetches all byte ranges in parallel.
throws exception if non-pre-fetched slice is requested later.
2025-04-30 00:49:40 -07:00
Kenny Daniel
1d65bc68bb
Move imports to non-exported functions (yields smaller types)
2025-04-27 12:31:39 -07:00
Kenny Daniel
b7db4653e7
Add another column to page_indexed test
2025-04-26 17:18:11 -07:00
Kenny Daniel
fe85ba1184
CHANGELOG
2025-04-17 01:45:02 -07:00
Sylvain Lesage
7f0b57e265
types must be the first element ( #74 )
...
* types must be the first element. Spotted by publint.dev
* Package test for exports
* Test package.json for string exports
---------
Co-authored-by: Kenny Daniel <platypii@gmail.com>
2025-04-16 21:29:43 +02:00
Kenny Daniel
319a0e9e57
Publish v1.12.1
2025-04-14 23:48:30 -07:00
Kenny Daniel
9a04cbccd3
Convert unsigned types
2025-04-14 23:20:58 -07:00
Sylvain Lesage
447a58eca4
pass custom fetch function to utils ( #73 )
...
* pass custom fetch function to utils
it can be used to implement retry logic.
* Update src/utils.js
Co-authored-by: Kenny Daniel <platypii@gmail.com>
---------
Co-authored-by: Kenny Daniel <platypii@gmail.com>
2025-04-15 00:37:05 +02:00
Kenny Daniel
8161983962
Publish v1.12.0
2025-04-11 04:43:11 -07:00
Kenny Daniel
11c7d8174a
LogicalType DECIMAL is not a LogicalTypeSimple
2025-04-11 00:21:55 -07:00
Kenny Daniel
f5274904b7
Add onPage callback to parquetRead
2025-04-10 23:29:58 -07:00
Kenny Daniel
90be536e05
Group selection of a row group into an object
2025-04-10 22:36:10 -07:00
Kenny Daniel
4df7095ab4
Group column decoding params into an object
2025-04-10 19:30:25 -07:00
Kenny Daniel
4645e34f97
Re-order types.d.ts to put important apis up front
2025-04-10 16:33:50 -07:00
Kenny Daniel
8740f14450
Publish v1.11.1
2025-04-09 17:35:49 -07:00
Kenny Daniel
972402d083
Fix handling of dictionary pages from parquet.net
2025-04-09 17:26:47 -07:00
Kenny Daniel
c2adfba626
Publish v1.11.0
2025-04-07 21:18:17 -07:00
Kenny Daniel
655444bcde
Fix continued data pages
...
Parquet allows consecutive pages to continue a previously assembled
list. Broke in hyparquet 1.9.0. Added continued_page.parquet test.
2025-04-07 17:40:23 -07:00
Kenny Daniel
6c225888c4
Skip unnecessary pages
...
Do this by passing rowGroupStart and rowGroupEnd for the rows to
fetch within a rowgroup. If a page is outside those bounds, we can
skip the page. Replaces rowLimit.
2025-04-07 00:40:17 -07:00
Kenny Daniel
ba74d58dd3
Test for reading the last row of files
2025-04-06 22:05:58 -07:00
Kenny Daniel
8c4c7456b4
Publish v1.10.4
2025-04-03 20:03:21 -07:00
Kenny Daniel
f9a10da20b
Type thrift
2025-04-03 19:20:00 -07:00
Kenny Daniel
474cd9053a
Publish v1.10.3
2025-04-02 23:53:25 -07:00
Kenny Daniel
b38b65f7c7
Refactor assembleLists to take a schemaPath
2025-04-02 23:39:55 -07:00
Kenny Daniel
1247f5d606
Split out readPage
...
Remove dict-page-offset-zero test because it's a malformed parquet file.
2025-04-02 20:27:10 -07:00
Kenny Daniel
a4b5c2a943
Publish v1.10.2
2025-03-31 23:26:35 -07:00
Kenny Daniel
6af6f43f44
Export more constants
2025-03-31 23:20:22 -07:00
Kenny Daniel
73a4f295e1
Publish v1.10.1
2025-03-25 15:50:30 -07:00
Kenny Daniel
85e1af66c1
Fix thrift parsing of crypto_metadata
2025-03-25 15:42:48 -07:00
Kenny Daniel
74e8cc8f41
Publish v1.10.0
2025-03-25 00:44:55 -07:00
Kenny Daniel
b9ad12f7cc
Map src to types with package exports ( #70 )
2025-03-21 04:55:33 -07:00
Kenny Daniel
9c201e00e5
Use defaultInitialFetchSize for both metadata and cachedAsyncBuffer
2025-03-20 16:05:41 -07:00
Kenny Daniel
4b094178b3
Move toVarInt to tests
2025-03-20 12:37:24 -07:00
Kenny Daniel
855d5be0ea
Publish v1.9.1
2025-03-17 23:56:13 -07:00
Kenny Daniel
95c47f243d
Add minSize parameter to cachedAsyncBuffer
2025-03-17 23:54:20 -07:00
Kenny Daniel
f37b2aea9f
for is faster than forEach
2025-03-17 10:18:01 -07:00
Kenny Daniel
97aef2adef
Publish v1.9.0
2025-03-10 23:36:46 -07:00
Kenny Daniel
d7f8d39de3
Return typed arrays in onChunk. Change readColumn to return DecodedArray[]. ( #67 )
...
Refactored readColumn to avoid `concat` operations.
This avoids extra copying and allocation.
2025-03-10 23:33:47 -07:00
Kenny Daniel
a9467f6c3d
Remove selfCopyBytes in favor of copyBytes
2025-03-10 20:56:00 -07:00
Kenny Daniel
2cd582ea5a
Remove unnecessary toJson in tests
2025-03-10 19:32:31 -07:00
Kenny Daniel
613cd0e639
Update README
2025-03-09 23:56:43 -07:00
Kenny Daniel
347cc86270
Publish v1.8.7
2025-03-09 11:22:23 -07:00
Kenny Daniel
4bbc7742e5
Comment out unnecessary length read in readRleBitPackedHybrid
2025-03-09 11:20:58 -07:00
Kenny Daniel
d950e7dfb4
Publish v1.8.6
2025-03-06 08:56:15 -08:00
Kenny Daniel
791a847e42
Revert "Simplify relative import paths"
...
This reverts commit e590f4ee03263460a389bdd29678015727cdcd5a.
2025-03-06 08:54:32 -08:00
Kenny Daniel
03c25eef7f
Publish v1.8.5
2025-03-05 15:50:04 -08:00
Kenny Daniel
e590f4ee03
Simplify relative import paths
2025-03-05 14:03:17 -08:00
Kenny Daniel
2456cdc85f
Better error messages
2025-03-04 11:05:22 -08:00