134 Commits

Author	SHA1	Message	Date
Kenny Daniel	a1ca1ef785	byte_stream_split_extended.gzip.parquet	2024-05-21 17:21:36 -07:00
Kenny Daniel	70387fa345	repeated_no_annotation.parquet	2024-05-20 23:09:31 -07:00
Kenny Daniel	d453313dca	Fix optional structs!	2024-05-20 05:03:33 -07:00
Kenny Daniel	9cd09b8eed	Byte stream split encoding	2024-05-20 04:09:32 -07:00
Kenny Daniel	1689d7473a	Delta length byte array encoding	2024-05-20 02:32:31 -07:00
Kenny Daniel	d4341b803e	Delta byte array encoding	2024-05-18 19:23:11 -07:00
Kenny Daniel	48d79e6a1d	Move deltaBinaryUnpack to delta.js and always consume miniblock	2024-05-18 18:57:17 -07:00
Kenny Daniel	f389e30565	Remove unnecessary parens	2024-05-18 18:26:52 -07:00
Kenny	cf4c4ba04d	Assembly of nested column types (#11)	2024-05-17 22:44:03 -07:00
Kenny Daniel	3f958ed25d	Handle skipNulls in assembleLists	2024-05-17 19:41:40 -07:00
Kenny Daniel	034e9cda16	Faster row transpose	2024-05-14 17:13:24 -07:00
Kenny Daniel	9f95eff222	Faster decimal conversion	2024-05-14 01:58:28 -07:00
Kenny Daniel	c83aa2ea5b	Float16	2024-05-13 20:36:53 -07:00
Kenny Daniel	7ae1f88047	Allow zero-width rle	2024-05-13 00:29:16 -07:00
Kenny Daniel	7639b8ca7f	Fix fixed length byte array type	2024-05-12 21:52:26 -07:00
Kenny Daniel	bd4e7c1699	Actually fix conversion of decimals	2024-05-12 20:53:28 -07:00
Kenny Daniel	fe7e19b2a4	Fix decimal conversion with precision	2024-05-12 19:52:15 -07:00
Kenny Daniel	e064efc66c	Int96 date parsing	2024-05-12 19:24:10 -07:00
Kenny Daniel	82db6a8017	Delta binary packed encoding	2024-05-12 15:47:16 -07:00
Kenny Daniel	4d960e0533	Convert consistently	2024-05-09 17:07:05 -07:00
Kenny Daniel	e398e66dd4	No utf8 in plain decoding	2024-05-09 16:28:50 -07:00
Kenny Daniel	5291ff1072	Use .set in case of unaligned read	2024-05-09 16:22:44 -07:00
Kenny Daniel	797db7b4df	Simplify isListLike and isMapLike	2024-05-06 13:33:39 -07:00
Kenny Daniel	12dc5a47f8	Add path to schemaTree	2024-05-06 13:23:18 -07:00
Kenny Daniel	892c933a05	Parse logical types	2024-05-05 16:13:19 -07:00
Kenny Daniel	57ed66646d	Convert statistics based on column type	2024-05-04 01:11:46 -07:00
Kenny Daniel	3d5d423694	Parse additional metadata	2024-05-04 01:03:42 -07:00
Kenny Daniel	eabf62f5a1	Return Uint8Array from thrift	2024-05-04 00:47:24 -07:00
Kenny Daniel	f86c8c6359	Update metadata types based on parquet.thrift schema, use bigint for i64 type.	2024-05-04 00:18:16 -07:00
Kenny Daniel	f411b83f5e	Fix min/max type definition	2024-05-02 17:29:39 -07:00
Kenny Daniel	bded3fb331	Encoding tests	2024-05-02 17:21:17 -07:00
Kenny Daniel	4d5c8324aa	TypedArrays	2024-05-01 23:23:55 -07:00
Kenny Daniel	d093b0dcaa	Use DataReader for thrift	2024-05-01 00:55:16 -07:00
Kenny Daniel	b8660baea1	Split out plain encoding	2024-04-30 20:28:50 -07:00
Kenny Daniel	af908b9b83	No copy readBitPacked	2024-04-30 19:59:58 -07:00
Kenny Daniel	3deab62000	No copy readRle	2024-04-30 17:30:08 -07:00
Kenny Daniel	f16e23f501	No copy readRleBitPackedHybrid	2024-04-30 14:40:18 -07:00
Kenny Daniel	195ee9bc80	Splice into fixed length array	2024-04-30 13:43:01 -07:00
Kenny Daniel	488bfa7f90	Preallocate arrays for faster decoding	2024-04-30 00:38:19 -07:00
Kenny Daniel	93ff9a9f99	Refactor isListLike and isMapLike to use schemaPath	2024-04-29 18:45:29 -07:00
Kenny Daniel	2c6a111113	Refactor to use schemaPath	2024-04-29 17:38:26 -07:00
Kenny Daniel	6ebb6a9ee8	isListLike and isMapLike tests	2024-04-29 17:16:47 -07:00
Kenny Daniel	a42cc558d0	Adjust read coalesce size	2024-04-29 16:43:07 -07:00
Kenny Daniel	54ef1e6b0a	Rewrite dremel assembly	2024-04-28 19:03:39 -07:00
Kenny Daniel	bf1b8d79c7	Simplify imports	2024-04-28 16:05:47 -07:00
Kenny Daniel	09ea11517c	Fix typescript definitions	2024-04-26 14:01:00 -07:00
Kenny Daniel	86273b110c	PageType enum to string	2024-04-18 00:21:13 -07:00
Kenny Daniel	f826bff757	Use DataReader over Decoded. Fewer allocations, slightly faster.	2024-04-17 23:43:04 -07:00
Kenny Daniel	4b7d864319	Error handling for missing byteLength	2024-04-17 17:48:35 -07:00
Kenny Daniel	00cbb6a3e6	Fix rowStart in onChunk callback. ... Also split out readFiles tests.	2024-04-12 23:34:56 -07:00