Commit Graph

12 Commits

Author SHA1 Message Date
Kenny Daniel
6727628aad
rowGroupSize option 2025-04-03 00:45:43 -07:00
Kenny Daniel
07928e8eb7
Moar tests 2025-03-31 13:32:41 -07:00
Kenny Daniel
4bf1595981
Allow specifying column type 2025-03-28 16:21:17 -07:00
Kenny Daniel
d70f727825
Dictionary encoding 2025-03-27 23:30:32 -07:00
Kenny Daniel
2e0431d815
Optional compression flag 2025-03-27 00:37:53 -07:00
Kenny Daniel
69d373ad61
Use snappy compressed pages 2025-03-27 00:01:24 -07:00
Kenny Daniel
aca7c2bde4
Fix RLE encoding bug 2025-03-26 23:59:04 -07:00
Kenny Daniel
c40e7c4320
Handle byte array vs string, and change parquetWrite column api 2025-03-26 01:01:04 -07:00
Kenny Daniel
abe825ded4
Handle more types (date and json)
Converts lists and object columns to json.
2025-03-26 00:11:14 -07:00
Kenny Daniel
947a78f72d
Choose best of RLE or bit-packed for hybrid encoding
sparse booleans: 2634 -> 1399 bytes
2025-03-25 23:02:24 -07:00
Kenny Daniel
44d0d0c77a
Support nullable columns 2025-03-25 22:38:23 -07:00
Kenny Daniel
05ee5e274f
Initial writer implementation 2025-03-25 21:09:06 -07:00