54 Commits

Author	SHA1	Message	Date
Kenny	a2024a781c	Parse column and offset indexes (#29) ... * Parse indicies * Add parsed offset indices * Add parsed column indices * Test readColumnIndex and readOffsetIndex * Add more parsed offset indices * Remove unnecessary toJson when loading expected results * Add length checks to convertMetadata * Rename indicies.js to indexes.js * Rename indices.test.js to indexes.test.js * Rename *_indices.json to *_indexes.json * Use asyncBufferFromFile in indexes.test.js --------- Co-authored-by: Brian Park <park-brian@users.noreply.github.com>	2024-08-18 18:23:54 -07:00
Kenny Daniel	c6c79c05ca	Fix for issue #23 nested struct assembly	2024-08-02 14:47:04 -07:00
Kenny Daniel	17f412c2f5	Convert logical date units	2024-05-24 16:55:13 -07:00
Kenny Daniel	efdbf459a5	Convert date and decimal stats	2024-05-24 15:22:59 -07:00
Kenny Daniel	a56420de2f	Parse metadata TimeUnit	2024-05-24 15:17:20 -07:00
Kenny Daniel	2edc14b70e	Convert unsigned ints	2024-05-23 23:35:49 -07:00
Kenny Daniel	c68256575b	Convert logical timestamp	2024-05-23 18:50:57 -07:00
Kenny Daniel	7a08aa3183	Handle repeated with no children	2024-05-23 18:26:16 -07:00
Kenny Daniel	ed3b525a27	Fix nested optional from duckdb#3734 🦆	2024-05-23 18:19:01 -07:00
Kenny Daniel	af7bab33f8	Handle top level repeated from duckdb#2557 🦆	2024-05-23 17:43:36 -07:00
Kenny Daniel	d92cc5fd22	Convert timestamps and json	2024-05-23 16:43:26 -07:00
Kenny Daniel	06578a9419	struct_strings.parquet	2024-05-23 02:10:04 -07:00
Kenny Daniel	7d1d877c9f	Fix metadata parsing of page_type	2024-05-23 00:11:58 -07:00
Kenny Daniel	b8e4496063	Upgrade dataPage to match dictionary type	2024-05-23 00:07:09 -07:00
Kenny Daniel	c4ad05e580	Convert byte arrays to utf8 by default	2024-05-22 22:40:21 -07:00
Kenny Daniel	1f8289b4b2	rle_boolean_encoding.parquet	2024-05-22 19:16:10 -07:00
Kenny Daniel	5eeb05da40	dict-page-offset-zero.parquet	2024-05-21 22:50:50 -07:00
Kenny Daniel	4f7791354c	incorrect_map_schema.parquet	2024-05-21 22:18:39 -07:00
Kenny Daniel	6a75a960da	Convert boolean column	2024-05-21 22:05:29 -07:00
Kenny Daniel	a1ca1ef785	byte_stream_split_extended.gzip.parquet	2024-05-21 17:21:36 -07:00
Kenny Daniel	70387fa345	repeated_no_annotation.parquet	2024-05-20 23:09:31 -07:00
Kenny Daniel	d453313dca	Fix optional structs!	2024-05-20 05:03:33 -07:00
Kenny Daniel	9cd09b8eed	Byte stream split encoding	2024-05-20 04:09:32 -07:00
Kenny Daniel	1689d7473a	Delta length byte array encoding	2024-05-20 02:32:31 -07:00
Kenny Daniel	da72c06ac2	Use hyparquet-compressors for tests (brotli, lz4, zstd)	2024-05-20 02:07:40 -07:00
Kenny Daniel	d4341b803e	Delta byte array encoding	2024-05-18 19:23:11 -07:00
Kenny Daniel	561f06f701	Int_Map test is redundant with nullable.impala.parquet	2024-05-18 18:33:15 -07:00
Kenny Daniel	3583aeb549	nullable.impala.parquet	2024-05-17 22:52:57 -07:00
Kenny	cf4c4ba04d	Assembly of nested column types (#11)	2024-05-17 22:44:03 -07:00
Kenny Daniel	c83aa2ea5b	Float16	2024-05-13 20:36:53 -07:00
Kenny Daniel	7639b8ca7f	Fix fixed length byte array type	2024-05-12 21:52:26 -07:00
Kenny Daniel	fe7e19b2a4	Fix decimal conversion with precision	2024-05-12 19:52:15 -07:00
Kenny Daniel	82db6a8017	Delta binary packed encoding	2024-05-12 15:47:16 -07:00
Kenny Daniel	892c933a05	Parse logical types	2024-05-05 16:13:19 -07:00
Kenny Daniel	57ed66646d	Convert statistics based on column type	2024-05-04 01:11:46 -07:00
Kenny Daniel	3d5d423694	Parse additional metadata	2024-05-04 01:03:42 -07:00
Kenny Daniel	09ea11517c	Fix typescript definitions	2024-04-26 14:01:00 -07:00
Kenny Daniel	d0213bf0f1	Snappy jpg test	2024-04-12 23:58:37 -07:00
Kenny Daniel	46df1ab454	Rewrite dremel assembly	2024-03-21 16:47:21 -07:00
Kenny Daniel	b0d653f342	Undefined int map	2024-03-19 09:09:15 -07:00
Kenny Daniel	4654c5eddf	Fix tests	2024-03-15 00:17:35 -07:00
Kenny Daniel	b14809a71a	Fix struct map parsing	2024-03-14 19:53:56 -07:00
Kenny Daniel	8a98407734	Parse logical types from metadata	2024-03-12 01:15:12 -07:00
Kenny Daniel	8b575ad2d8	ParquetType as string	2024-02-27 11:31:17 -08:00
Kenny Daniel	11f35c9e43	Encoding as string	2024-02-27 10:51:57 -08:00
Kenny Daniel	e3b5fca883	Custom decompressors	2024-02-27 09:05:02 -08:00
Kenny Daniel	a65132b79c	Data Page V2	2024-02-26 18:44:33 -08:00
Kenny Daniel	e2b85304b3	Fix UTF8 decoding	2024-02-16 16:27:00 -08:00
Kenny Daniel	d02c68e883	Fix isRequired and add parquet-testing impala test	2024-02-16 16:07:09 -08:00
Kenny Daniel	5f4e2ffe59	parquet-testing byte_array_decimal	2024-02-13 22:05:37 -08:00