Commit Graph

293 Commits

Author SHA1 Message Date
Kenny Daniel
e6301a8bc8
demo: use web worker for parquet parsing to avoid blocking main thread 2024-09-25 02:22:30 -07:00
Kenny Daniel
4f1b0bb74d
Upgrade eslint 😭 2024-09-25 00:31:27 -07:00
Kenny Daniel
9d49dabc15
Query api 2024-09-24 21:01:04 -07:00
Kenny Daniel
9a2f4fdcba
Update dependencies 2024-09-24 16:54:44 -07:00
Kenny Daniel
c77388fb5e
demo: show parquet errors 2024-09-20 13:31:10 -07:00
Kenny Daniel
b10c38147c
demo: fix styles and click to select file 2024-09-17 16:22:16 -07:00
Kenny Daniel
e0a9a25577
demo: hyparquet pronunciation 2024-09-16 14:37:47 -07:00
Kenny Daniel
706d0721c0
demo: url parsing and links 2024-09-15 23:06:06 -07:00
Kenny Daniel
58e42a8ac7
demo: sortable hightable! ↕️ 2024-09-14 17:17:12 -07:00
Kenny Daniel
28ec43b49b
React metadata and file layout components 2024-09-13 18:19:14 -07:00
Kenny Daniel
0711e86d33
Hyperparam style for demo 2024-09-13 17:32:53 -07:00
Kenny Daniel
c6111423c1
demo: split out dropzone 2024-09-12 20:30:57 -07:00
Kenny Daniel
eef1a94eff
demo: add column size to file layout 2024-09-06 14:57:01 -07:00
Kenny Daniel
aafa676a51
Add demo image 2024-09-04 12:52:39 -07:00
Kenny Daniel
1de02e9747
HighTable demo 2024-08-28 00:56:35 -07:00
Kenny Daniel
c20cc90af9
Publish v1.3.0 2024-08-20 12:05:46 -07:00
Kenny Daniel
df02229407
Promisified parquetReadObjects function 2024-08-20 11:30:39 -07:00
Kenny
a2024a781c
Parse column and offset indexes (#29)
* Parse indicies

* Add parsed offset indices

* Add parsed column indices

* Test readColumnIndex and readOffsetIndex

* Add more parsed offset indices

* Remove unnecessary toJson when loading expected results

* Add length checks to convertMetadata

* Rename indicies.js to indexes.js

* Rename indices.test.js to indexes.test.js

* Rename *_indices.json to *_indexes.json

* Use asyncBufferFromFile in indexes.test.js

---------

Co-authored-by: Brian Park <park-brian@users.noreply.github.com>
2024-08-18 18:23:54 -07:00
Kenny Daniel
7eb1e05515
Publish v1.2.1 2024-08-14 22:06:31 -07:00
Kenny Daniel
b1c8a1dd8b
Revert onComplete type signature change from #25
The type change caused a lot of downstream type errors.
If you pass rowFormat: 'object' then it will return Record<string, any>[]
instead of any[][]. This means the types are not aligned with behavior.
Will figure out how to fix it later, for now don't want break downstream projects.
2024-08-14 22:00:32 -07:00
Kenny Daniel
da9fbc68b8
Publish v1.2.0 2024-08-14 00:03:28 -07:00
ctranstrum
8ace1a47d2
return column names in the order requested (#27)
* return column names in the order requested

* retain correct ordering of columns in object rows as well
2024-08-14 00:01:47 -07:00
ctranstrum
d13d52b606
Add an option to return each row as an object keyed by column name (#25)
* Add an option to return each row as an object keyed by column name

* rename option to rowFormat and address feedback
2024-08-13 09:15:59 -07:00
Kenny Daniel
400c73607c
Publish v1.1.1 2024-08-02 16:24:05 -07:00
Kenny Daniel
8e0235413a
Update dependencies 2024-08-02 16:12:57 -07:00
Kenny Daniel
0e807587e1
Prevent webpack from trying to include node fs 2024-08-02 16:04:22 -07:00
Kenny Daniel
c6c79c05ca
Fix for issue #23 nested struct assembly 2024-08-02 14:47:04 -07:00
Kenny Daniel
23f6529a73
Publish v1.1.0 2024-07-26 17:21:27 -07:00
Kenny Daniel
83e06c3465
Export asyncBufferFromFile, asyncBufferFromUrl and add to README 2024-07-26 17:18:36 -07:00
Kenny Daniel
a5122e61d6
utils: asyncBufferFromFile 2024-07-26 15:07:47 -07:00
Kenny Daniel
5188b3c764
utils: asyncBufferFromUrl 2024-07-26 14:12:35 -07:00
Kenny Daniel
8714ad4d22
Update README 2024-07-25 19:49:21 -07:00
Kenny Daniel
a6293259f6
Add favicon to demo 2024-07-23 12:55:17 -07:00
Kenny Daniel
bebfa976b0
Publish v1.0.1 2024-07-23 08:02:40 -07:00
Kenny Daniel
5ec5121f31 Await benchmark example.parquet download 2024-07-23 07:59:12 -07:00
Kenny Daniel
cb1263564e
Update dependencies 2024-07-22 22:24:37 -07:00
Kenny Daniel
58a6b963a1 Fix out of order columns in onComplete 2024-07-22 21:45:18 -07:00
Kenny Daniel
1885c96c53
Fix readStreamToArrayBuffer 2024-07-02 16:35:59 -07:00
Kenny Daniel
8762256d9a
Use hyparquet-compressors in benchmark 2024-07-02 16:33:42 -07:00
Kenny Daniel
3ea58cb0b9
Use hyparquet-compressors in the demo 2024-06-27 19:01:34 -07:00
Kenny Daniel
9cd2e3b666
Fix row limit for structs 2024-06-25 17:41:50 -07:00
Kenny Daniel
543eba0307
HYPARQUET 1.0.0 2024-06-23 22:12:08 -07:00
Kenny Daniel
60630f9963
Hugging Face Open-Source Grant 2024-06-18 09:56:42 -07:00
Kenny Daniel
54934d916c
Demo row numbers 2024-06-14 00:02:57 -07:00
Kenny Daniel
9ab5004cd8
Bit pack testing 2024-06-13 21:33:28 -07:00
Kenny Daniel
c314ebb14e
Publish v0.9.10 2024-06-13 00:18:29 -07:00
Kenny Daniel
72cdffef7c
Fix readBitPacked for 17+ bitwidth 2024-06-13 00:10:45 -07:00
Kenny Daniel
b22416d7f1
Publish v0.9.9 2024-06-07 23:25:36 -07:00
Kenny Daniel
ddb8b16cd0
Fix handling of multiple pages 2024-06-07 23:16:04 -07:00
Kenny Daniel
6d769a4336
Demo: move to folder, typecheck, and render column indices 2024-05-31 19:40:44 -07:00