Commit Graph

284 Commits

Author SHA1 Message Date
Kenny Daniel
28ec43b49b
React metadata and file layout components 2024-09-13 18:19:14 -07:00
Kenny Daniel
0711e86d33
Hyperparam style for demo 2024-09-13 17:32:53 -07:00
Kenny Daniel
c6111423c1
demo: split out dropzone 2024-09-12 20:30:57 -07:00
Kenny Daniel
eef1a94eff
demo: add column size to file layout 2024-09-06 14:57:01 -07:00
Kenny Daniel
aafa676a51
Add demo image 2024-09-04 12:52:39 -07:00
Kenny Daniel
1de02e9747
HighTable demo 2024-08-28 00:56:35 -07:00
Kenny Daniel
c20cc90af9
Publish v1.3.0 2024-08-20 12:05:46 -07:00
Kenny Daniel
df02229407
Promisified parquetReadObjects function 2024-08-20 11:30:39 -07:00
Kenny
a2024a781c
Parse column and offset indexes (#29)
* Parse indicies

* Add parsed offset indices

* Add parsed column indices

* Test readColumnIndex and readOffsetIndex

* Add more parsed offset indices

* Remove unnecessary toJson when loading expected results

* Add length checks to convertMetadata

* Rename indicies.js to indexes.js

* Rename indices.test.js to indexes.test.js

* Rename *_indices.json to *_indexes.json

* Use asyncBufferFromFile in indexes.test.js

---------

Co-authored-by: Brian Park <park-brian@users.noreply.github.com>
2024-08-18 18:23:54 -07:00
Kenny Daniel
7eb1e05515
Publish v1.2.1 2024-08-14 22:06:31 -07:00
Kenny Daniel
b1c8a1dd8b
Revert onComplete type signature change from #25
The type change caused a lot of downstream type errors.
If you pass rowFormat: 'object' then it will return Record<string, any>[]
instead of any[][]. This means the types are not aligned with behavior.
Will figure out how to fix it later, for now don't want break downstream projects.
2024-08-14 22:00:32 -07:00
Kenny Daniel
da9fbc68b8
Publish v1.2.0 2024-08-14 00:03:28 -07:00
ctranstrum
8ace1a47d2
return column names in the order requested (#27)
* return column names in the order requested

* retain correct ordering of columns in object rows as well
2024-08-14 00:01:47 -07:00
ctranstrum
d13d52b606
Add an option to return each row as an object keyed by column name (#25)
* Add an option to return each row as an object keyed by column name

* rename option to rowFormat and address feedback
2024-08-13 09:15:59 -07:00
Kenny Daniel
400c73607c
Publish v1.1.1 2024-08-02 16:24:05 -07:00
Kenny Daniel
8e0235413a
Update dependencies 2024-08-02 16:12:57 -07:00
Kenny Daniel
0e807587e1
Prevent webpack from trying to include node fs 2024-08-02 16:04:22 -07:00
Kenny Daniel
c6c79c05ca
Fix for issue #23 nested struct assembly 2024-08-02 14:47:04 -07:00
Kenny Daniel
23f6529a73
Publish v1.1.0 2024-07-26 17:21:27 -07:00
Kenny Daniel
83e06c3465
Export asyncBufferFromFile, asyncBufferFromUrl and add to README 2024-07-26 17:18:36 -07:00
Kenny Daniel
a5122e61d6
utils: asyncBufferFromFile 2024-07-26 15:07:47 -07:00
Kenny Daniel
5188b3c764
utils: asyncBufferFromUrl 2024-07-26 14:12:35 -07:00
Kenny Daniel
8714ad4d22
Update README 2024-07-25 19:49:21 -07:00
Kenny Daniel
a6293259f6
Add favicon to demo 2024-07-23 12:55:17 -07:00
Kenny Daniel
bebfa976b0
Publish v1.0.1 2024-07-23 08:02:40 -07:00
Kenny Daniel
5ec5121f31 Await benchmark example.parquet download 2024-07-23 07:59:12 -07:00
Kenny Daniel
cb1263564e
Update dependencies 2024-07-22 22:24:37 -07:00
Kenny Daniel
58a6b963a1 Fix out of order columns in onComplete 2024-07-22 21:45:18 -07:00
Kenny Daniel
1885c96c53
Fix readStreamToArrayBuffer 2024-07-02 16:35:59 -07:00
Kenny Daniel
8762256d9a
Use hyparquet-compressors in benchmark 2024-07-02 16:33:42 -07:00
Kenny Daniel
3ea58cb0b9
Use hyparquet-compressors in the demo 2024-06-27 19:01:34 -07:00
Kenny Daniel
9cd2e3b666
Fix row limit for structs 2024-06-25 17:41:50 -07:00
Kenny Daniel
543eba0307
HYPARQUET 1.0.0 2024-06-23 22:12:08 -07:00
Kenny Daniel
60630f9963
Hugging Face Open-Source Grant 2024-06-18 09:56:42 -07:00
Kenny Daniel
54934d916c
Demo row numbers 2024-06-14 00:02:57 -07:00
Kenny Daniel
9ab5004cd8
Bit pack testing 2024-06-13 21:33:28 -07:00
Kenny Daniel
c314ebb14e
Publish v0.9.10 2024-06-13 00:18:29 -07:00
Kenny Daniel
72cdffef7c
Fix readBitPacked for 17+ bitwidth 2024-06-13 00:10:45 -07:00
Kenny Daniel
b22416d7f1
Publish v0.9.9 2024-06-07 23:25:36 -07:00
Kenny Daniel
ddb8b16cd0
Fix handling of multiple pages 2024-06-07 23:16:04 -07:00
Kenny Daniel
6d769a4336
Demo: move to folder, typecheck, and render column indices 2024-05-31 19:40:44 -07:00
Kenny Daniel
941c6633a0
Publish v0.9.8 2024-05-28 14:40:05 -07:00
Kenny Daniel
9db378de2f
toJson tests 2024-05-28 14:24:12 -07:00
Kenny Daniel
f28735c0ce
readVarInt tests 2024-05-28 14:18:04 -07:00
Kenny Daniel
490d1ec800
Fix 3-byte RLE 2024-05-28 13:58:02 -07:00
Kenny Daniel
dbebcde118
Publish v0.9.7 2024-05-27 16:55:14 -07:00
Kenny Daniel
36f5b4f043
Move decompressPage to avoid circular dependency chain 2024-05-27 12:54:42 -07:00
Kenny Daniel
e44078ac9e
Remove oversimplified dremel demo 2024-05-27 12:53:03 -07:00
Kenny Daniel
17f412c2f5
Convert logical date units 2024-05-24 16:55:13 -07:00
Kenny Daniel
efdbf459a5
Convert date and decimal stats 2024-05-24 15:22:59 -07:00