70 Commits

Author	SHA1	Message	Date
Kenny Daniel	11efa2849a	Byte split stream	2025-11-26 16:11:15 -08:00
Kenny Daniel	c30f8fa8eb	User encoding options	2025-11-26 12:03:29 -08:00
Kenny Daniel	4da31a5f83	Delta binary packed	2025-11-26 11:55:38 -08:00
Kenny Daniel	5dadd5f7ef	Return ColumnChunk from writeColumn	2025-11-26 10:15:08 -08:00
Kenny Daniel	b2ea21b366	Rename PageData	2025-11-20 22:38:10 -08:00
Kenny Daniel	3c5714996e	Fix json serialization of bigints	2025-11-13 00:43:10 -08:00
Kenny Daniel	bfb1d74bf8	Geospatial stats (#13)	2025-10-26 14:30:49 -07:00
Kenny Daniel	ee346e7d08	Update schemaOverrides to allow nested column types, and fix the README	2025-10-23 12:15:56 -07:00
Kenny Daniel	4715a4a429	Geospatial (#12)	2025-10-23 12:11:25 -07:00
Kenny Daniel	a56c78de39	Fix thrift encoding when delta > 15	2025-10-23 10:58:44 -07:00
Kenny Daniel	e64e66abaa	Dremel list encoding	2025-10-21 00:43:50 -07:00
Kenny Daniel	1ac0c70197	Refactor ColumnEncoder to pass around column info	2025-10-21 00:43:37 -07:00
Kenny Daniel	22e40cf6c4	Handle optional json columns	2025-07-28 17:06:42 -07:00
Kenny Daniel	538740f578	rowGroupSize can be an array	2025-07-04 01:43:07 -07:00
Kenny Daniel	5957c219bc	Allow null columns to be auto-typed	2025-05-31 23:06:17 -07:00
Kenny Daniel	3f21e329cc	Publish v0.5.0	2025-05-31 17:34:07 -07:00
Kenny Daniel	9d0ab4faa8	Export node by default for better next.js support. ... Also move fileWriter into node.js file.	2025-05-31 17:33:26 -07:00
Kenny Daniel	37508f69aa	Export types	2025-05-31 17:00:15 -07:00
Kenny Daniel	b8227afdde	Rename ColumnData to ColumnSource	2025-05-31 16:57:00 -07:00
Kenny Daniel	791a70b983	Refactor api to support arbitrary parquet schemas (#3) ... * Refactor api to support arbitrary parquet schemas * More detail in README and error messages * Export schema tools with optional overrides * Test for basic timestamp type * Fix time-type tests * schemaFromColumnData should take an options object * Update README with schemaFromColumnData options	2025-05-09 14:47:22 -07:00
Kenny Daniel	842ff4c15e	Repeated types not yet supported	2025-04-21 23:01:11 -07:00
Kenny Daniel	b11b92ffb9	UUID and improved fixed length byte array support	2025-04-21 12:32:51 -07:00
Kenny Daniel	edabe74bd6	Float16	2025-04-21 11:32:13 -07:00
Kenny Daniel	5ecc4ff52e	RLE encoding for booleans	2025-04-20 22:54:03 -07:00
Kenny Daniel	263dae7101	Check for safe integers	2025-04-20 20:03:24 -07:00
Kenny Daniel	5a3d6e8d3f	Pass bitWidth to writeRleBitPackedHybrid to avoid re-scanning data	2025-04-20 19:23:44 -07:00
Kenny Daniel	786816c55f	Set dictionary threshold to 2	2025-04-19 01:15:13 -07:00
Kenny Daniel	fa9006221d	Fix statistics writing for dates and decimals	2025-04-19 00:34:21 -07:00
Kenny Daniel	de03425587	Don't write file_path, duckdb doesn't like it	2025-04-17 01:13:46 -07:00
Kenny Daniel	b92886bf16	Split out node.js exports	2025-04-17 00:38:17 -07:00
Kenny Daniel	c15bcbe2b8	Find bitwidth faster for large arrays	2025-04-15 23:45:29 -07:00
Kenny Daniel	c38151e32f	TPCH benchmark	2025-04-15 22:55:21 -07:00
Kenny Daniel	18294de6ec	Fix offset handling for filewriter	2025-04-15 22:33:58 -07:00
Kenny Daniel	903530f1ff	Publish v0.2.3	2025-04-14 23:40:27 -07:00
Kenny Daniel	7e064bd7b0	Update README	2025-04-14 23:27:07 -07:00
Kenny Daniel	26daec2fcb	Split out writeDataPageV2	2025-04-13 22:43:09 -07:00
Kenny Daniel	6226d50734	Move helpers to datapage.js	2025-04-13 17:28:49 -07:00
Kenny Daniel	070d9591b0	Fix DATE converted type	2025-04-11 19:40:17 -06:00
Kenny Daniel	fde7f81893	Fixed length byte array decimals	2025-04-11 17:51:53 -06:00
Kenny Daniel	94435ed335	Fix metadata thrift encoding	2025-04-11 04:47:28 -07:00
Kenny Daniel	10f23492e6	Unconvert decimal type	2025-04-11 04:38:06 -07:00
Kenny Daniel	fff0b1c6d9	Support more SchemaElement options	2025-04-11 02:50:38 -07:00
Kenny Daniel	6545196a1d	Float life	2025-04-08 04:39:58 -07:00
Kenny Daniel	5c686412c1	FileWriter	2025-04-08 03:22:30 -07:00
Kenny Daniel	41ddace347	BYO writer	2025-04-08 01:05:19 -07:00
Kenny Daniel	5e89e80cad	Stream writer	2025-04-07 01:29:38 -07:00
Kenny Daniel	2bd2e396d2	Write statistics	2025-04-03 20:39:37 -07:00
Kenny Daniel	ae829f7c9b	Move convert to unconvert and test it	2025-04-03 20:31:37 -07:00
Kenny Daniel	cec00d9699	Type thrift	2025-04-03 20:13:38 -07:00
Kenny Daniel	6727628aad	rowGroupSize option	2025-04-03 00:45:43 -07:00