Kenny Daniel
acdbb22828
Update geospatial and variant metadata from thrift spec
2025-10-23 18:49:05 -07:00
Sylvain Lesage
e8b1c8e570
Minimal support for GeoParquet ( #133 )
...
* Initial support for GeoParquet
* pr comments
* convert crs
* add test file + expected JSON files
* add sentence to README
* Apply suggestion from @platypii
Co-authored-by: Kenny Daniel <platypii@gmail.com>
* PR comments
* update README
* review comment
---------
Co-authored-by: Kenny Daniel <platypii@gmail.com>
2025-10-16 04:22:01 -04:00
Kenny Daniel
cc6cc86ba4
Fix geospatial metadata parsing
2025-09-28 22:31:37 -07:00
Kenny Daniel
2f00330527
Parse geospatial_statistics ( #130 )
2025-09-27 16:31:16 -07:00
Kenny Daniel
78c621fdc5
Fix geospatial metadata parsing
2025-09-26 23:54:39 -07:00
Kenny Daniel
8611663334
Custom string parser option ( #129 )
2025-09-26 19:07:25 -07:00
LiraNuna
8609192b23
Introduce 'custom parsers' option for decoding dates ( #87 )
2025-06-09 18:02:31 -07:00
Kenny Daniel
bf6ac3b644
Simplify error messages
2025-05-25 17:49:39 -07:00
Kenny Daniel
c6bc226180
parquetSchema more generic argument
2025-05-17 17:52:48 -07:00
Kenny Daniel
85e1af66c1
Fix thrift parsing of crypto_metadata
2025-03-25 15:42:48 -07:00
Kenny Daniel
9c201e00e5
Use defaultInitialFetchSize for both metadata and cachedAsyncBuffer
2025-03-20 16:05:41 -07:00
Kenny Daniel
791a847e42
Revert "Simplify relative import paths"
...
This reverts commit e590f4ee03263460a389bdd29678015727cdcd5a.
2025-03-06 08:54:32 -08:00
Kenny Daniel
e590f4ee03
Simplify relative import paths
2025-03-05 14:03:17 -08:00
Kenny Daniel
2456cdc85f
Better error messages
2025-03-04 11:05:22 -08:00
Kenny Daniel
36d8ea2e1d
Fix handling of signed decimals ( #60 )
2025-02-07 18:52:48 -08:00
Sylvain Lesage
09ae9400c5
build types before publishing to npm ( #46 )
...
* build types before publishing to npm
* use prepare instead of prepublishOnly + make it clear that we only build types
doc for prepare vs prepublishOnly is here: https://docs.npmjs.com/cli/v8/using-npm/scripts
* no jsx in this lib
* relative imports from the root, so that it works from types/
* remove unused hyparquet.d.ts + report differences to jsdoc in files
* try to understand if this is the cause of the failing CI check
tsc fails: https://github.com/hyparam/hyparquet/actions/runs/12040954822/job/33571851170?pr=46
* Revert "try to understand if this is the cause of the failing CI check"
This reverts commit 5e2fc8ca179064369de71793ab1cda3facefddc7.
* not sure what happens, but we just need to ensure the types are created correctly
* increment version
* Explicitly export types for use in downstream typescript projects
* Use new typescript jsdoc imports for smaller package
* Combine some files and use @import jsdoc
* use the local typescript
---------
Co-authored-by: Kenny Daniel <platypii@gmail.com>
2024-12-02 17:47:42 +01:00
Carlos Bardasano
9aacd15349
Fix metadata timestamp conversion ( #45 )
...
* Fix metadata timestamp conversion
* Remove redundant check
Co-authored-by: Kenny Daniel <platypii@gmail.com>
---------
Co-authored-by: Kenny Daniel <platypii@gmail.com>
2024-11-29 13:48:06 -08:00
Kenny
a2024a781c
Parse column and offset indexes ( #29 )
...
* Parse indicies
* Add parsed offset indices
* Add parsed column indices
* Test readColumnIndex and readOffsetIndex
* Add more parsed offset indices
* Remove unnecessary toJson when loading expected results
* Add length checks to convertMetadata
* Rename indicies.js to indexes.js
* Rename indices.test.js to indexes.test.js
* Rename *_indices.json to *_indexes.json
* Use asyncBufferFromFile in indexes.test.js
---------
Co-authored-by: Brian Park <park-brian@users.noreply.github.com>
2024-08-18 18:23:54 -07:00
Kenny Daniel
17f412c2f5
Convert logical date units
2024-05-24 16:55:13 -07:00
Kenny Daniel
efdbf459a5
Convert date and decimal stats
2024-05-24 15:22:59 -07:00
Kenny Daniel
a56420de2f
Parse metadata TimeUnit
2024-05-24 15:17:20 -07:00
Kenny Daniel
7d1d877c9f
Fix metadata parsing of page_type
2024-05-23 00:11:58 -07:00
Kenny Daniel
d4341b803e
Delta byte array encoding
2024-05-18 19:23:11 -07:00
Kenny Daniel
c83aa2ea5b
Float16
2024-05-13 20:36:53 -07:00
Kenny Daniel
892c933a05
Parse logical types
2024-05-05 16:13:19 -07:00
Kenny Daniel
57ed66646d
Convert statistics based on column type
2024-05-04 01:11:46 -07:00
Kenny Daniel
3d5d423694
Parse additional metadata
2024-05-04 01:03:42 -07:00
Kenny Daniel
eabf62f5a1
Return Uint8Array from thrift
2024-05-04 00:47:24 -07:00
Kenny Daniel
d093b0dcaa
Use DataReader for thrift
2024-05-01 00:55:16 -07:00
Kenny Daniel
2c6a111113
Refactor to use schemaPath
2024-04-29 17:38:26 -07:00
Kenny Daniel
bf1b8d79c7
Simplify imports
2024-04-28 16:05:47 -07:00
Kenny Daniel
4b7d864319
Error handling for missing byteLength
2024-04-17 17:48:35 -07:00
Kenny Daniel
dd91122753
Update README with example for Async and Row/Column filtering
2024-04-11 13:11:58 -07:00
Kenny Daniel
48dc10fd18
Error handling for undefined parquet file
2024-04-05 11:11:39 -07:00
Kenny Daniel
c6ad30b59a
schemaElement returns trees
2024-03-12 20:39:15 -07:00
Kenny Daniel
8a98407734
Parse logical types from metadata
2024-03-12 01:15:12 -07:00
Kenny Daniel
8b575ad2d8
ParquetType as string
2024-02-27 11:31:17 -08:00
Kenny Daniel
11f35c9e43
Encoding as string
2024-02-27 10:51:57 -08:00
Kenny Daniel
8f7cd07734
Human readable metadata types
2024-02-11 15:22:52 -08:00
Kenny Daniel
961b92650c
Never copy data
2024-02-09 14:35:11 -08:00
Kenny Daniel
5623b67ad5
Check for magic number before reading metadata length.
...
Also make sure that metadata length is available.
2024-02-02 12:59:13 -08:00
Kenny Daniel
800b39b575
Fix initial fetch size larger > file size
2024-02-01 23:28:36 -08:00
Kenny Daniel
8d7b145439
Export parquetSchema tree
2024-01-19 21:23:32 -08:00
Kenny Daniel
c2b48ab2fe
parquetMetadataAsync tests
2024-01-15 13:40:12 -08:00
Kenny Daniel
be7f2a8c77
Async metadata fetching
2024-01-15 12:30:35 -08:00
Kenny Daniel
03727d0156
Include metadata length in metadata
2024-01-12 14:36:50 -08:00
Kenny Daniel
62632d9333
Metadata test rowgroups.parquet
2024-01-11 11:10:36 -08:00
Kenny Daniel
954671f810
Export toJson
2024-01-05 01:39:59 -08:00
Kenny Daniel
04bfd474b8
All javascript, no typescript
2024-01-04 11:11:00 -08:00
Kenny Daniel
769876a8af
Metadata TS to JS
2024-01-04 10:36:29 -08:00
