Commit Graph

43 Commits

Author SHA1 Message Date
Kenny Daniel
4bbc7742e5
Comment out unnecessary length read in readRleBitPackedHybrid 2025-03-09 11:20:58 -07:00
Kenny Daniel
791a847e42
Revert "Simplify relative import paths"
This reverts commit e590f4ee03263460a389bdd29678015727cdcd5a.
2025-03-06 08:54:32 -08:00
Kenny Daniel
e590f4ee03
Simplify relative import paths 2025-03-05 14:03:17 -08:00
Johan Levin
bf268e141c
Use prepended length for bit-packed hybrid bool columns (#62) 2025-02-19 11:07:49 -08:00
Sylvain Lesage
09ae9400c5
build types before publishing to npm (#46)
* build types before publishing to npm

* use prepare instead of prepublishOnly + make it clear that we only build types

doc for prepare vs prepublishOnly is here: https://docs.npmjs.com/cli/v8/using-npm/scripts

* no jsx in this lib

* relative imports from the root, so that it works from types/

* remove unused hyparquet.d.ts + report differences to jsdoc in files

* try to understand if this is the cause of the failing CI check

tsc fails: https://github.com/hyparam/hyparquet/actions/runs/12040954822/job/33571851170?pr=46

* Revert "try to understand if this is the cause of the failing CI check"

This reverts commit 5e2fc8ca179064369de71793ab1cda3facefddc7.

* not sure what happens, but we just need to ensure the types are created correctly

* increment version

* Explicitly export types for use in downstream typescript projects

* Use new typescript jsdoc imports for smaller package

* Combine some files and use @import jsdoc

* use the local typescript

---------

Co-authored-by: Kenny Daniel <platypii@gmail.com>
2024-12-02 17:47:42 +01:00
Kenny Daniel
72cdffef7c
Fix readBitPacked for 17+ bitwidth 2024-06-13 00:10:45 -07:00
Kenny Daniel
490d1ec800
Fix 3-byte RLE 2024-05-28 13:58:02 -07:00
Kenny Daniel
1f8289b4b2
rle_boolean_encoding.parquet 2024-05-22 19:16:10 -07:00
Kenny Daniel
9369faad46
Code cleanup 🧹 2024-05-22 12:58:37 -07:00
Kenny Daniel
66b832d5bb
Fix RLE encoding length 2024-05-21 18:41:57 -07:00
Kenny Daniel
a1ca1ef785
byte_stream_split_extended.gzip.parquet 2024-05-21 17:21:36 -07:00
Kenny Daniel
70387fa345
repeated_no_annotation.parquet 2024-05-20 23:09:31 -07:00
Kenny Daniel
9cd09b8eed
Byte stream split encoding 2024-05-20 04:09:32 -07:00
Kenny Daniel
f389e30565
Remove unnecessary parens 2024-05-18 18:26:52 -07:00
Kenny Daniel
7ae1f88047
Allow zero-width rle 2024-05-13 00:29:16 -07:00
Kenny Daniel
bded3fb331
Encoding tests 2024-05-02 17:21:17 -07:00
Kenny Daniel
4d5c8324aa
TypedArrays 2024-05-01 23:23:55 -07:00
Kenny Daniel
d093b0dcaa
Use DataReader for thrift 2024-05-01 00:55:16 -07:00
Kenny Daniel
b8660baea1
Split out plain encoding 2024-04-30 20:28:50 -07:00
Kenny Daniel
af908b9b83
No copy readBitPacked 2024-04-30 19:59:58 -07:00
Kenny Daniel
3deab62000
No copy readRle 2024-04-30 17:30:08 -07:00
Kenny Daniel
f16e23f501
No copy readRleBitPackedHybrid 2024-04-30 14:40:18 -07:00
Kenny Daniel
195ee9bc80
Splice into fixed length array 2024-04-30 13:43:01 -07:00
Kenny Daniel
488bfa7f90
Preallocate arrays for faster decoding 2024-04-30 00:38:19 -07:00
Kenny Daniel
86273b110c
PageType enum to string 2024-04-18 00:21:13 -07:00
Kenny Daniel
f826bff757
Use DataReader over Decoded. Fewer allocations, slightly faster. 2024-04-17 23:43:04 -07:00
Kenny Daniel
6ffdeca103
Fast array concat 2024-04-07 09:59:37 -07:00
Kenny Daniel
429fd9e813
Fix max call stack error in browser: concat not spread... 2024-04-06 22:01:42 -07:00
Kenny Daniel
8b575ad2d8
ParquetType as string 2024-02-27 11:31:17 -08:00
Kenny Daniel
11f35c9e43
Encoding as string 2024-02-27 10:51:57 -08:00
Kenny Daniel
87d78ab06e
Oops fix the other tests 2024-02-26 22:51:57 -08:00
Kenny Daniel
a65132b79c
Data Page V2 2024-02-26 18:44:33 -08:00
Kenny Daniel
c70b3b2227
Prepare for data page v2 2024-02-26 11:44:28 -08:00
Kenny Daniel
ada7429685
Prepare for alternate decompressors 2024-02-21 13:44:12 -08:00
Kenny Daniel
e2b85304b3
Fix UTF8 decoding 2024-02-16 16:27:00 -08:00
Kenny Daniel
8f7cd07734
Human readable metadata types 2024-02-11 15:22:52 -08:00
Kenny Daniel
17f7ace840
Fix bug in readData, support more parquet files 2024-02-11 14:27:38 -08:00
Kenny Daniel
6d03bd6d86
Fix definition level parsing 2024-01-20 18:18:32 -08:00
Kenny Daniel
a5a9824715
Encoding readRleBitPackedHybrid tests 2024-01-14 19:43:49 -08:00
Kenny Daniel
6ca1d2a85c
Consistent parquet error messages 2024-01-12 17:54:42 -08:00
Kenny Daniel
58aed8d9cd
Update README 2024-01-09 15:15:08 -08:00
Kenny Daniel
92902c41d3
Parquet header parser 2024-01-05 03:08:42 -08:00
Kenny Daniel
be7085c1a6
Parquet encoding 2024-01-05 02:16:15 -08:00