asadbek064/hyparquet
1
Fork 0
mirror of https://github.com/asadbek064/hyparquet.git synced 2025-12-06 06:51:54 +00:00
Code Issues Actions Projects Releases Wiki Activity
a2024a781c
hyparquet/test/files
History
Kenny a2024a781c
Parse column and offset indexes (#29) 
* Parse indicies

* Add parsed offset indices

* Add parsed column indices

* Test readColumnIndex and readOffsetIndex

* Add more parsed offset indices

* Remove unnecessary toJson when loading expected results

* Add length checks to convertMetadata

* Rename indicies.js to indexes.js

* Rename indices.test.js to indexes.test.js

* Rename *_indices.json to *_indexes.json

* Use asyncBufferFromFile in indexes.test.js

---------

Co-authored-by: Brian Park <park-brian@users.noreply.github.com>
2024-08-18 18:23:54 -07:00
..
adam_genotypes.column_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
adam_genotypes.json Handle repeated with no children 2024-05-23 18:26:16 -07:00
adam_genotypes.metadata.json Handle repeated with no children 2024-05-23 18:26:16 -07:00
adam_genotypes.offset_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
adam_genotypes.parquet Handle repeated with no children 2024-05-23 18:26:16 -07:00
brotli_compressed.json Convert byte arrays to utf8 by default 2024-05-22 22:40:21 -07:00
brotli_compressed.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
brotli_compressed.parquet Use hyparquet-compressors for tests (brotli, lz4, zstd) 2024-05-20 02:07:40 -07:00
byte_array_decimal.json Fix decimal conversion with precision 2024-05-12 19:52:15 -07:00
byte_array_decimal.metadata.json ParquetType as string 2024-02-27 11:31:17 -08:00
byte_array_decimal.parquet parquet-testing byte_array_decimal 2024-02-13 22:05:37 -08:00
byte_stream_split_extended.gzip.json byte_stream_split_extended.gzip.parquet 2024-05-21 17:21:36 -07:00
byte_stream_split_extended.gzip.metadata.json Convert date and decimal stats 2024-05-24 15:22:59 -07:00
byte_stream_split_extended.gzip.parquet byte_stream_split_extended.gzip.parquet 2024-05-21 17:21:36 -07:00
byte_stream_split.zstd.json Byte stream split encoding 2024-05-20 04:09:32 -07:00
byte_stream_split.zstd.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
byte_stream_split.zstd.parquet Byte stream split encoding 2024-05-20 04:09:32 -07:00
concatenated_gzip_members.json Custom decompressors 2024-02-27 09:05:02 -08:00
concatenated_gzip_members.metadata.json Parse logical types 2024-05-05 16:13:19 -07:00
concatenated_gzip_members.parquet Custom decompressors 2024-02-27 09:05:02 -08:00
datapage_v2.snappy.json Convert boolean column 2024-05-21 22:05:29 -07:00
datapage_v2.snappy.metadata.json Convert statistics based on column type 2024-05-04 01:11:46 -07:00
datapage_v2.snappy.parquet Data Page V2 2024-02-26 18:44:33 -08:00
delta_binary_packed.json Delta binary packed encoding 2024-05-12 15:47:16 -07:00
delta_binary_packed.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
delta_binary_packed.parquet Delta binary packed encoding 2024-05-12 15:47:16 -07:00
delta_byte_array.json Delta byte array encoding 2024-05-18 19:23:11 -07:00
delta_byte_array.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
delta_byte_array.parquet Delta byte array encoding 2024-05-18 19:23:11 -07:00
delta_encoding_optional_column.json Delta byte array encoding 2024-05-18 19:23:11 -07:00
delta_encoding_optional_column.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
delta_encoding_optional_column.parquet Delta byte array encoding 2024-05-18 19:23:11 -07:00
delta_encoding_required_column.column_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
delta_encoding_required_column.json Delta byte array encoding 2024-05-18 19:23:11 -07:00
delta_encoding_required_column.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
delta_encoding_required_column.offset_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
delta_encoding_required_column.parquet Delta byte array encoding 2024-05-18 19:23:11 -07:00
delta_length_byte_array.json Delta length byte array encoding 2024-05-20 02:32:31 -07:00
delta_length_byte_array.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
delta_length_byte_array.parquet Delta length byte array encoding 2024-05-20 02:32:31 -07:00
dict-page-offset-zero.column_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
dict-page-offset-zero.json dict-page-offset-zero.parquet 2024-05-21 22:50:50 -07:00
dict-page-offset-zero.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
dict-page-offset-zero.offset_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
dict-page-offset-zero.parquet dict-page-offset-zero.parquet 2024-05-21 22:50:50 -07:00
duckdb2557.json Handle top level repeated from duckdb#2557 🦆 2024-05-23 17:43:36 -07:00
duckdb2557.metadata.json Handle top level repeated from duckdb#2557 🦆 2024-05-23 17:43:36 -07:00
duckdb2557.parquet Handle top level repeated from duckdb#2557 🦆 2024-05-23 17:43:36 -07:00
duckdb3734.json Fix nested optional from duckdb#3734 🦆 2024-05-23 18:19:01 -07:00
duckdb3734.metadata.json Fix nested optional from duckdb#3734 🦆 2024-05-23 18:19:01 -07:00
duckdb3734.parquet Fix nested optional from duckdb#3734 🦆 2024-05-23 18:19:01 -07:00
duckdb4442.column_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
duckdb4442.json Convert logical date units 2024-05-24 16:55:13 -07:00
duckdb4442.metadata.json Convert logical date units 2024-05-24 16:55:13 -07:00
duckdb4442.offset_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
duckdb4442.parquet Convert logical date units 2024-05-24 16:55:13 -07:00
duckdb5533.column_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
duckdb5533.json Convert logical timestamp 2024-05-23 18:50:57 -07:00
duckdb5533.metadata.json Convert date and decimal stats 2024-05-24 15:22:59 -07:00
duckdb5533.offset_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
duckdb5533.parquet Convert logical timestamp 2024-05-23 18:50:57 -07:00
fixed_length_decimal.json Fix fixed length byte array type 2024-05-12 21:52:26 -07:00
fixed_length_decimal.metadata.json Convert date and decimal stats 2024-05-24 15:22:59 -07:00
fixed_length_decimal.parquet Fix fixed length byte array type 2024-05-12 21:52:26 -07:00
float16_nonzeros_and_nans.json Float16 2024-05-13 20:36:53 -07:00
float16_nonzeros_and_nans.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
float16_nonzeros_and_nans.parquet Float16 2024-05-13 20:36:53 -07:00
hadoop_lz4_compressed.json Convert byte arrays to utf8 by default 2024-05-22 22:40:21 -07:00
hadoop_lz4_compressed.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
hadoop_lz4_compressed.parquet Use hyparquet-compressors for tests (brotli, lz4, zstd) 2024-05-20 02:07:40 -07:00
hyparquet.jpg.snappy Snappy jpg test 2024-04-12 23:58:37 -07:00
incorrect_map_schema.column_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
incorrect_map_schema.json incorrect_map_schema.parquet 2024-05-21 22:18:39 -07:00
incorrect_map_schema.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
incorrect_map_schema.offset_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
incorrect_map_schema.parquet incorrect_map_schema.parquet 2024-05-21 22:18:39 -07:00
issue23.json Fix for issue #23 nested struct assembly 2024-08-02 14:47:04 -07:00
issue23.metadata.json Fix for issue #23 nested struct assembly 2024-08-02 14:47:04 -07:00
issue23.parquet Fix for issue #23 nested struct assembly 2024-08-02 14:47:04 -07:00
lz4_raw_compressed.json Convert byte arrays to utf8 by default 2024-05-22 22:40:21 -07:00
lz4_raw_compressed.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
lz4_raw_compressed.parquet Use hyparquet-compressors for tests (brotli, lz4, zstd) 2024-05-20 02:07:40 -07:00
nested_structs.rust.json Convert timestamps and json 2024-05-23 16:43:26 -07:00
nested_structs.rust.metadata.json Convert date and decimal stats 2024-05-24 15:22:59 -07:00
nested_structs.rust.parquet Use hyparquet-compressors for tests (brotli, lz4, zstd) 2024-05-20 02:07:40 -07:00
nonnullable.impala.json Assembly of nested column types (#11) 2024-05-17 22:44:03 -07:00
nonnullable.impala.metadata.json Convert statistics based on column type 2024-05-04 01:11:46 -07:00
nonnullable.impala.parquet Fix isRequired and add parquet-testing impala test 2024-02-16 16:07:09 -08:00
nullable.impala.json Fix optional structs! 2024-05-20 05:03:33 -07:00
nullable.impala.metadata.json nullable.impala.parquet 2024-05-17 22:52:57 -07:00
nullable.impala.parquet nullable.impala.parquet 2024-05-17 22:52:57 -07:00
plain-dict-uncompressed-checksum.column_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
plain-dict-uncompressed-checksum.json Upgrade dataPage to match dictionary type 2024-05-23 00:07:09 -07:00
plain-dict-uncompressed-checksum.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
plain-dict-uncompressed-checksum.offset_indexes.json Parse column and offset indexes (#29) 2024-08-18 18:23:54 -07:00
plain-dict-uncompressed-checksum.parquet Upgrade dataPage to match dictionary type 2024-05-23 00:07:09 -07:00
README.md Fix typescript definitions 2024-04-26 14:01:00 -07:00
repeated_no_annotation.json repeated_no_annotation.parquet 2024-05-20 23:09:31 -07:00
repeated_no_annotation.metadata.json repeated_no_annotation.parquet 2024-05-20 23:09:31 -07:00
repeated_no_annotation.parquet repeated_no_annotation.parquet 2024-05-20 23:09:31 -07:00
rle_boolean_encoding.json rle_boolean_encoding.parquet 2024-05-22 19:16:10 -07:00
rle_boolean_encoding.metadata.json rle_boolean_encoding.parquet 2024-05-22 19:16:10 -07:00
rle_boolean_encoding.parquet rle_boolean_encoding.parquet 2024-05-22 19:16:10 -07:00
rowgroups.json Test read of all sample files 2024-02-13 21:12:11 -08:00
rowgroups.metadata.json Fix metadata parsing of page_type 2024-05-23 00:11:58 -07:00
rowgroups.parquet Metadata test rowgroups.parquet 2024-01-11 11:10:36 -08:00
struct_strings.json struct_strings.parquet 2024-05-23 02:10:04 -07:00
struct_strings.metadata.json struct_strings.parquet 2024-05-23 02:10:04 -07:00
struct_strings.parquet struct_strings.parquet 2024-05-23 02:10:04 -07:00
unsigned.json Convert unsigned ints 2024-05-23 23:35:49 -07:00
unsigned.metadata.json Convert unsigned ints 2024-05-23 23:35:49 -07:00
unsigned.parquet Convert unsigned ints 2024-05-23 23:35:49 -07:00

README.md

Test Files License

This directory contains binary test files from apache/parquet-testing, under the Apache 2.0 license.

Copyright 2004 The Apache Software Foundation (http://www.apache.org/).