126 Commits

Author	SHA1	Message	Date
Kenny Daniel	df02229407	Promisified parquetReadObjects function	2024-08-20 11:30:39 -07:00
Kenny	a2024a781c	Parse column and offset indexes (#29) ... * Parse indicies * Add parsed offset indices * Add parsed column indices * Test readColumnIndex and readOffsetIndex * Add more parsed offset indices * Remove unnecessary toJson when loading expected results * Add length checks to convertMetadata * Rename indicies.js to indexes.js * Rename indices.test.js to indexes.test.js * Rename *_indices.json to *_indexes.json * Use asyncBufferFromFile in indexes.test.js --------- Co-authored-by: Brian Park <park-brian@users.noreply.github.com>	2024-08-18 18:23:54 -07:00
ctranstrum	8ace1a47d2	return column names in the order requested (#27) ... * return column names in the order requested * retain correct ordering of columns in object rows as well	2024-08-14 00:01:47 -07:00
ctranstrum	d13d52b606	Add an option to return each row as an object keyed by column name (#25) ... * Add an option to return each row as an object keyed by column name * rename option to rowFormat and address feedback	2024-08-13 09:15:59 -07:00
Kenny Daniel	c6c79c05ca	Fix for issue #23 nested struct assembly	2024-08-02 14:47:04 -07:00
Kenny Daniel	a5122e61d6	utils: asyncBufferFromFile	2024-07-26 15:07:47 -07:00
Kenny Daniel	9ab5004cd8	Bit pack testing	2024-06-13 21:33:28 -07:00
Kenny Daniel	ddb8b16cd0	Fix handling of multiple pages	2024-06-07 23:16:04 -07:00
Kenny Daniel	9db378de2f	toJson tests	2024-05-28 14:24:12 -07:00
Kenny Daniel	f28735c0ce	readVarInt tests	2024-05-28 14:18:04 -07:00
Kenny Daniel	490d1ec800	Fix 3-byte RLE	2024-05-28 13:58:02 -07:00
Kenny Daniel	17f412c2f5	Convert logical date units	2024-05-24 16:55:13 -07:00
Kenny Daniel	efdbf459a5	Convert date and decimal stats	2024-05-24 15:22:59 -07:00
Kenny Daniel	a56420de2f	Parse metadata TimeUnit	2024-05-24 15:17:20 -07:00
Kenny Daniel	2edc14b70e	Convert unsigned ints	2024-05-23 23:35:49 -07:00
Kenny Daniel	10b9b299d8	Fix complex.parquet	2024-05-23 23:20:16 -07:00
Kenny Daniel	c68256575b	Convert logical timestamp	2024-05-23 18:50:57 -07:00
Kenny Daniel	7a08aa3183	Handle repeated with no children	2024-05-23 18:26:16 -07:00
Kenny Daniel	ed3b525a27	Fix nested optional from duckdb#3734 🦆	2024-05-23 18:19:01 -07:00
Kenny Daniel	af7bab33f8	Handle top level repeated from duckdb#2557 🦆	2024-05-23 17:43:36 -07:00
Kenny Daniel	d92cc5fd22	Convert timestamps and json	2024-05-23 16:43:26 -07:00
Kenny Daniel	06578a9419	struct_strings.parquet	2024-05-23 02:10:04 -07:00
Kenny Daniel	7d1d877c9f	Fix metadata parsing of page_type	2024-05-23 00:11:58 -07:00
Kenny Daniel	b8e4496063	Upgrade dataPage to match dictionary type	2024-05-23 00:07:09 -07:00
Kenny Daniel	c4ad05e580	Convert byte arrays to utf8 by default	2024-05-22 22:40:21 -07:00
Kenny Daniel	1f8289b4b2	rle_boolean_encoding.parquet	2024-05-22 19:16:10 -07:00
Kenny Daniel	9369faad46	Code cleanup 🧹	2024-05-22 12:58:37 -07:00
Kenny Daniel	5eeb05da40	dict-page-offset-zero.parquet	2024-05-21 22:50:50 -07:00
Kenny Daniel	4f7791354c	incorrect_map_schema.parquet	2024-05-21 22:18:39 -07:00
Kenny Daniel	6a75a960da	Convert boolean column	2024-05-21 22:05:29 -07:00
Kenny Daniel	66b832d5bb	Fix RLE encoding length	2024-05-21 18:41:57 -07:00
Kenny Daniel	a1ca1ef785	byte_stream_split_extended.gzip.parquet	2024-05-21 17:21:36 -07:00
Kenny Daniel	70387fa345	repeated_no_annotation.parquet	2024-05-20 23:09:31 -07:00
Kenny Daniel	d453313dca	Fix optional structs!	2024-05-20 05:03:33 -07:00
Kenny Daniel	9cd09b8eed	Byte stream split encoding	2024-05-20 04:09:32 -07:00
Kenny Daniel	1689d7473a	Delta length byte array encoding	2024-05-20 02:32:31 -07:00
Kenny Daniel	da72c06ac2	Use hyparquet-compressors for tests (brotli, lz4, zstd)	2024-05-20 02:07:40 -07:00
Kenny Daniel	d4341b803e	Delta byte array encoding	2024-05-18 19:23:11 -07:00
Kenny Daniel	561f06f701	Int_Map test is redundant with nullable.impala.parquet	2024-05-18 18:33:15 -07:00
Kenny Daniel	f389e30565	Remove unnecessary parens	2024-05-18 18:26:52 -07:00
Kenny Daniel	3583aeb549	nullable.impala.parquet	2024-05-17 22:52:57 -07:00
Kenny	cf4c4ba04d	Assembly of nested column types (#11)	2024-05-17 22:44:03 -07:00
Kenny Daniel	3f958ed25d	Handle skipNulls in assembleLists	2024-05-17 19:41:40 -07:00
Kenny Daniel	9f95eff222	Faster decimal conversion	2024-05-14 01:58:28 -07:00
Kenny Daniel	c83aa2ea5b	Float16	2024-05-13 20:36:53 -07:00
Kenny Daniel	7639b8ca7f	Fix fixed length byte array type	2024-05-12 21:52:26 -07:00
Kenny Daniel	bd4e7c1699	Actually fix conversion of decimals	2024-05-12 20:53:28 -07:00
Kenny Daniel	fe7e19b2a4	Fix decimal conversion with precision	2024-05-12 19:52:15 -07:00
Kenny Daniel	e064efc66c	Int96 date parsing	2024-05-12 19:24:10 -07:00
Kenny Daniel	82db6a8017	Delta binary packed encoding	2024-05-12 15:47:16 -07:00