asadbek064/hyparquet-compressors
1
Fork 0
mirror of https://github.com/asadbek064/hyparquet-compressors.git synced 2026-01-12 05:36:37 +00:00
Code Issues Actions Projects Releases Wiki Activity

Hyparquet Parakeets

Browse Source
This commit is contained in:
Kenny Daniel 2024-05-27 23:15:25 -07:00
parent a0385f4158
commit cf99de03a6
No known key found for this signature in database
GPG Key ID: 90AB653A8CAD7E45
3 changed files with 6 additions and 4 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

8
README.md
View File

@ -1,5 +1,7 @@
# hyparquet decompressors
![hyparquet parakeets](hyparquet-compressors.jpg)
[![npm](https://img.shields.io/npm/v/hyparquet-compressors)](https://www.npmjs.com/package/hyparquet-compressors)
[![workflow status](https://github.com/hyparam/hyparquet-compressors/actions/workflows/ci.yml/badge.svg)](https://github.com/hyparam/hyparquet-compressors/actions)
[![mit license](https://img.shields.io/badge/License-MIT-blue.svg)](https://opensource.org/licenses/MIT)
@ -43,11 +45,11 @@ Snappy compression uses [hysnappy](https://github.com/hyparam/hysnappy) for fast
## Gzip
New gzip implementation adapted from [fflate](https://github.com/101arrowz/fflate).
Includes modifications to handle repeated back-to-back gzip streams that sometimes occur in parquet files, but was not supported by fflate.
Includes modifications to handle repeated back-to-back gzip streams that sometimes occur in parquet files (but was not supported by fflate).
## Brotli
Includes a minimal port of [brotli.js](https://github.com/foliojs/brotli.js) which compresses the brotli dictionary using gzip and base64 to minimize the distribution bundle size.
Includes a minimal port of [brotli.js](https://github.com/foliojs/brotli.js) which pre-compresses the brotli dictionary using gzip to minimize the distribution bundle size.
## LZ4
@ -60,7 +62,7 @@ Uses [fzstd](https://github.com/101arrowz/fzstd) for Zstandard decompression.
# Bundle size
| File | Size |
| - | - |
| --- | --- |
| hyparquet-compressors.min.js | 116.1kb |
| hyparquet-compressors.min.js.gz | 75.2kb |

BIN
hyparquet-compressors.jpg Normal file
View File

Binary file not shown.
Side by Side

After

Width:  |  Height:  |  Size: 89 KiB

2
package.json
View File

@ -45,7 +45,7 @@
"eslint": "8.57.0",
"eslint-plugin-import": "2.29.1",
"eslint-plugin-jsdoc": "48.2.6",
"hyparquet": "0.9.6",
"hyparquet": "0.9.7",
"rollup": "4.18.0",
"typescript": "5.4.5",
"vitest": "1.6.0"