42 Commits

Author	SHA1	Message	Date
Kenny Daniel	de03425587	Don't write file_path, duckdb doesn't like it	2025-04-17 01:13:46 -07:00
Kenny Daniel	b92886bf16	Split out node.js exports	2025-04-17 00:38:17 -07:00
Kenny Daniel	c15bcbe2b8	Find bitwidth faster for large arrays	2025-04-15 23:45:29 -07:00
Kenny Daniel	c38151e32f	TPCH benchmark	2025-04-15 22:55:21 -07:00
Kenny Daniel	18294de6ec	Fix offset handling for filewriter	2025-04-15 22:33:58 -07:00
Kenny Daniel	903530f1ff	Publish v0.2.3	2025-04-14 23:40:27 -07:00
Kenny Daniel	7e064bd7b0	Update README	2025-04-14 23:27:07 -07:00
Kenny Daniel	26daec2fcb	Split out writeDataPageV2	2025-04-13 22:43:09 -07:00
Kenny Daniel	6226d50734	Move helpers to datapage.js	2025-04-13 17:28:49 -07:00
Kenny Daniel	070d9591b0	Fix DATE converted type	2025-04-11 19:40:17 -06:00
Kenny Daniel	fde7f81893	Fixed length byte array decimals	2025-04-11 17:51:53 -06:00
Kenny Daniel	94435ed335	Fix metadata thrift encoding	2025-04-11 04:47:28 -07:00
Kenny Daniel	10f23492e6	Unconvert decimal type	2025-04-11 04:38:06 -07:00
Kenny Daniel	fff0b1c6d9	Support more SchemaElement options	2025-04-11 02:50:38 -07:00
Kenny Daniel	6545196a1d	Float life	2025-04-08 04:39:58 -07:00
Kenny Daniel	5c686412c1	FileWriter	2025-04-08 03:22:30 -07:00
Kenny Daniel	41ddace347	BYO writer	2025-04-08 01:05:19 -07:00
Kenny Daniel	5e89e80cad	Stream writer	2025-04-07 01:29:38 -07:00
Kenny Daniel	2bd2e396d2	Write statistics	2025-04-03 20:39:37 -07:00
Kenny Daniel	ae829f7c9b	Move convert to unconvert and test it	2025-04-03 20:31:37 -07:00
Kenny Daniel	cec00d9699	Type thrift	2025-04-03 20:13:38 -07:00
Kenny Daniel	6727628aad	rowGroupSize option	2025-04-03 00:45:43 -07:00
Kenny Daniel	3729f4cb5e	Use constants from hyparquet	2025-04-01 22:57:58 -07:00
Kenny Daniel	7be21caa9e	Option for key_value_metadata	2025-03-31 13:49:06 -07:00
Kenny Daniel	07928e8eb7	Moar tests	2025-03-31 13:32:41 -07:00
Kenny Daniel	4bf1595981	Allow specifying column type	2025-03-28 16:21:17 -07:00
Kenny Daniel	d70f727825	Dictionary encoding	2025-03-27 23:30:32 -07:00
Kenny Daniel	2e0431d815	Optional compression flag	2025-03-27 00:37:53 -07:00
Kenny Daniel	69d373ad61	Use snappy compressed pages	2025-03-27 00:01:24 -07:00
Kenny Daniel	aca7c2bde4	Fix RLE encoding bug	2025-03-26 23:59:04 -07:00
Kenny Daniel	45f3301eb8	Snappy compression	2025-03-26 23:38:25 -07:00
Kenny Daniel	c40e7c4320	Handle byte array vs string, and change parquetWrite column api	2025-03-26 01:01:04 -07:00
Kenny Daniel	abe825ded4	Handle more types (date and json) ... Converts lists and object columns to json.	2025-03-26 00:11:14 -07:00
Kenny Daniel	947a78f72d	Choose best of RLE or bit-packed for hybrid encoding ... sparse booleans: 2634 -> 1399 bytes	2025-03-25 23:02:24 -07:00
Kenny Daniel	44d0d0c77a	Support nullable columns	2025-03-25 22:38:23 -07:00
Kenny Daniel	05ee5e274f	Initial writer implementation	2025-03-25 21:09:06 -07:00
Kenny Daniel	c20356087b	Plain string support	2025-03-25 20:17:06 -07:00
Kenny Daniel	c7d84e0e9d	Write metadata	2025-03-25 17:52:30 -07:00
Kenny Daniel	a0560ee412	Write plain encoding	2025-03-25 16:44:28 -07:00
Kenny Daniel	76889680b9	Write BitPacked	2025-03-25 13:36:23 -07:00
Kenny Daniel	045256b478	Thrift writer	2025-03-25 10:30:37 -07:00
Kenny Daniel	3a29bb7bca	Initial JS project	2025-03-21 00:08:34 -07:00