33 Commits

Author	SHA1	Message	Date
Kenny	a2024a781c	Parse column and offset indexes (#29) ... * Parse indicies * Add parsed offset indices * Add parsed column indices * Test readColumnIndex and readOffsetIndex * Add more parsed offset indices * Remove unnecessary toJson when loading expected results * Add length checks to convertMetadata * Rename indicies.js to indexes.js * Rename indices.test.js to indexes.test.js * Rename *_indices.json to *_indexes.json * Use asyncBufferFromFile in indexes.test.js --------- Co-authored-by: Brian Park <park-brian@users.noreply.github.com>	2024-08-18 18:23:54 -07:00
Kenny Daniel	8e0235413a	Update dependencies	2024-08-02 16:12:57 -07:00
Kenny Daniel	17f412c2f5	Convert logical date units	2024-05-24 16:55:13 -07:00
Kenny Daniel	a56420de2f	Parse metadata TimeUnit	2024-05-24 15:17:20 -07:00
Kenny Daniel	2edc14b70e	Convert unsigned ints	2024-05-23 23:35:49 -07:00
Kenny Daniel	034e9cda16	Faster row transpose	2024-05-14 17:13:24 -07:00
Kenny Daniel	c83aa2ea5b	Float16	2024-05-13 20:36:53 -07:00
Kenny Daniel	12dc5a47f8	Add path to schemaTree	2024-05-06 13:23:18 -07:00
Kenny Daniel	892c933a05	Parse logical types	2024-05-05 16:13:19 -07:00
Kenny Daniel	57ed66646d	Convert statistics based on column type	2024-05-04 01:11:46 -07:00
Kenny Daniel	f86c8c6359	Update metadata types based on parquet.thrift schema, use bigint for i64 type.	2024-05-04 00:18:16 -07:00
Kenny Daniel	f411b83f5e	Fix min/max type definition	2024-05-02 17:29:39 -07:00
Kenny Daniel	4d5c8324aa	TypedArrays	2024-05-01 23:23:55 -07:00
Kenny Daniel	d093b0dcaa	Use DataReader for thrift	2024-05-01 00:55:16 -07:00
Kenny Daniel	09ea11517c	Fix typescript definitions	2024-04-26 14:01:00 -07:00
Kenny Daniel	86273b110c	PageType enum to string	2024-04-18 00:21:13 -07:00
Kenny Daniel	f826bff757	Use DataReader over Decoded. Fewer allocations, slightly faster.	2024-04-17 23:43:04 -07:00
Kenny Daniel	8a98407734	Parse logical types from metadata	2024-03-12 01:15:12 -07:00
Kenny Daniel	0f4708b954	Change compressors to return Uint8Array	2024-02-27 19:45:56 -08:00
Kenny Daniel	8b575ad2d8	ParquetType as string	2024-02-27 11:31:17 -08:00
Kenny Daniel	11f35c9e43	Encoding as string	2024-02-27 10:51:57 -08:00
Kenny Daniel	e3b5fca883	Custom decompressors	2024-02-27 09:05:02 -08:00
Kenny Daniel	ca971ccc01	Split out convert function	2024-02-26 12:20:48 -08:00
Kenny Daniel	c70b3b2227	Prepare for data page v2	2024-02-26 11:44:28 -08:00
Kenny Daniel	8f7cd07734	Human readable metadata types	2024-02-11 15:22:52 -08:00
Kenny Daniel	619f790795	Convert rich types	2024-01-20 18:30:10 -08:00
Kenny Daniel	8d7b145439	Export parquetSchema tree	2024-01-19 21:23:32 -08:00
Kenny Daniel	be7f2a8c77	Async metadata fetching	2024-01-15 12:30:35 -08:00
Kenny Daniel	060ef950b2	offsetArrayBuffer to return an offset view of an array buffer	2024-01-14 13:38:05 -08:00
Kenny Daniel	03727d0156	Include metadata length in metadata	2024-01-12 14:36:50 -08:00
Kenny Daniel	92902c41d3	Parquet header parser	2024-01-05 03:08:42 -08:00
Kenny Daniel	954671f810	Export toJson	2024-01-05 01:39:59 -08:00
Kenny Daniel	59484af27c	Rename types.ts to types.d.ts	2024-01-04 09:46:55 -08:00