Commit Graph

184 Commits

Author SHA1 Message Date
Sylvain Lesage
6ec836dac5
pass requestInit to fetch utils (#34)
* pass requestInit to fetch utils

It will allow authentication

* add tests
2024-11-08 22:22:30 +01:00
Kenny Daniel
5d21b09b7a
Export cachedAsyncBuffer 2024-10-16 01:29:31 -07:00
Kenny Daniel
bb202dfdeb
Fix util export types 2024-10-04 21:46:35 -07:00
Matthew Peveler
c8033621f9 Export additional types
Signed-off-by: Matthew Peveler <mpeveler@timescale.com>
2024-10-04 21:30:32 -07:00
Kenny Daniel
e6301a8bc8
demo: use web worker for parquet parsing to avoid blocking main thread 2024-09-25 02:22:30 -07:00
Kenny Daniel
9d49dabc15
Query api 2024-09-24 21:01:04 -07:00
Kenny Daniel
9a2f4fdcba
Update dependencies 2024-09-24 16:54:44 -07:00
Kenny Daniel
df02229407
Promisified parquetReadObjects function 2024-08-20 11:30:39 -07:00
Kenny
a2024a781c
Parse column and offset indexes (#29)
* Parse indicies

* Add parsed offset indices

* Add parsed column indices

* Test readColumnIndex and readOffsetIndex

* Add more parsed offset indices

* Remove unnecessary toJson when loading expected results

* Add length checks to convertMetadata

* Rename indicies.js to indexes.js

* Rename indices.test.js to indexes.test.js

* Rename *_indices.json to *_indexes.json

* Use asyncBufferFromFile in indexes.test.js

---------

Co-authored-by: Brian Park <park-brian@users.noreply.github.com>
2024-08-18 18:23:54 -07:00
Kenny Daniel
b1c8a1dd8b
Revert onComplete type signature change from #25
The type change caused a lot of downstream type errors.
If you pass rowFormat: 'object' then it will return Record<string, any>[]
instead of any[][]. This means the types are not aligned with behavior.
Will figure out how to fix it later, for now don't want break downstream projects.
2024-08-14 22:00:32 -07:00
ctranstrum
8ace1a47d2
return column names in the order requested (#27)
* return column names in the order requested

* retain correct ordering of columns in object rows as well
2024-08-14 00:01:47 -07:00
ctranstrum
d13d52b606
Add an option to return each row as an object keyed by column name (#25)
* Add an option to return each row as an object keyed by column name

* rename option to rowFormat and address feedback
2024-08-13 09:15:59 -07:00
Kenny Daniel
8e0235413a
Update dependencies 2024-08-02 16:12:57 -07:00
Kenny Daniel
0e807587e1
Prevent webpack from trying to include node fs 2024-08-02 16:04:22 -07:00
Kenny Daniel
c6c79c05ca
Fix for issue #23 nested struct assembly 2024-08-02 14:47:04 -07:00
Kenny Daniel
83e06c3465
Export asyncBufferFromFile, asyncBufferFromUrl and add to README 2024-07-26 17:18:36 -07:00
Kenny Daniel
a5122e61d6
utils: asyncBufferFromFile 2024-07-26 15:07:47 -07:00
Kenny Daniel
5188b3c764
utils: asyncBufferFromUrl 2024-07-26 14:12:35 -07:00
Kenny Daniel
58a6b963a1 Fix out of order columns in onComplete 2024-07-22 21:45:18 -07:00
Kenny Daniel
9cd2e3b666
Fix row limit for structs 2024-06-25 17:41:50 -07:00
Kenny Daniel
72cdffef7c
Fix readBitPacked for 17+ bitwidth 2024-06-13 00:10:45 -07:00
Kenny Daniel
ddb8b16cd0
Fix handling of multiple pages 2024-06-07 23:16:04 -07:00
Kenny Daniel
6d769a4336
Demo: move to folder, typecheck, and render column indices 2024-05-31 19:40:44 -07:00
Kenny Daniel
9db378de2f
toJson tests 2024-05-28 14:24:12 -07:00
Kenny Daniel
f28735c0ce
readVarInt tests 2024-05-28 14:18:04 -07:00
Kenny Daniel
490d1ec800
Fix 3-byte RLE 2024-05-28 13:58:02 -07:00
Kenny Daniel
36f5b4f043
Move decompressPage to avoid circular dependency chain 2024-05-27 12:54:42 -07:00
Kenny Daniel
17f412c2f5
Convert logical date units 2024-05-24 16:55:13 -07:00
Kenny Daniel
efdbf459a5
Convert date and decimal stats 2024-05-24 15:22:59 -07:00
Kenny Daniel
a56420de2f
Parse metadata TimeUnit 2024-05-24 15:17:20 -07:00
Kenny Daniel
9aebdb2917
Convert dictionary before dereferencing, and check encoding 2024-05-24 14:33:29 -07:00
Kenny Daniel
f4877dcd49
Publish v0.9.6! 2024-05-24 00:19:37 -07:00
Kenny Daniel
2edc14b70e
Convert unsigned ints 2024-05-23 23:35:49 -07:00
Kenny Daniel
10b9b299d8
Fix complex.parquet 2024-05-23 23:20:16 -07:00
Kenny Daniel
0926bfc2a0
Data page v2 is_compressed flag 2024-05-23 20:08:18 -07:00
Kenny Daniel
c68256575b
Convert logical timestamp 2024-05-23 18:50:57 -07:00
Kenny Daniel
7a08aa3183
Handle repeated with no children 2024-05-23 18:26:16 -07:00
Kenny Daniel
ed3b525a27
Fix nested optional from duckdb#3734 🦆 2024-05-23 18:19:01 -07:00
Kenny Daniel
af7bab33f8
Handle top level repeated from duckdb#2557 🦆 2024-05-23 17:43:36 -07:00
Kenny Daniel
d92cc5fd22
Convert timestamps and json 2024-05-23 16:43:26 -07:00
Kenny Daniel
06578a9419
struct_strings.parquet 2024-05-23 02:10:04 -07:00
Kenny Daniel
7d1d877c9f
Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
Kenny Daniel
b8e4496063
Upgrade dataPage to match dictionary type 2024-05-23 00:07:09 -07:00
Kenny Daniel
c4ad05e580
Convert byte arrays to utf8 by default 2024-05-22 22:40:21 -07:00
Kenny Daniel
1f8289b4b2
rle_boolean_encoding.parquet 2024-05-22 19:16:10 -07:00
Kenny Daniel
9369faad46
Code cleanup 🧹 2024-05-22 12:58:37 -07:00
Kenny Daniel
5eeb05da40
dict-page-offset-zero.parquet 2024-05-21 22:50:50 -07:00
Kenny Daniel
4f7791354c
incorrect_map_schema.parquet 2024-05-21 22:18:39 -07:00
Kenny Daniel
6a75a960da
Convert boolean column 2024-05-21 22:05:29 -07:00
Kenny Daniel
66b832d5bb
Fix RLE encoding length 2024-05-21 18:41:57 -07:00