60 Commits

Author	SHA1	Message	Date
Kenny Daniel	11efa2849a	Byte split stream	2025-11-26 16:11:15 -08:00
Kenny Daniel	c30f8fa8eb	User encoding options	2025-11-26 12:03:29 -08:00
Kenny Daniel	4da31a5f83	Delta binary packed	2025-11-26 11:55:38 -08:00
Kenny Daniel	bfb1d74bf8	Geospatial stats (#13)	2025-10-26 14:30:49 -07:00
Kenny Daniel	ee346e7d08	Update schemaOverrides to allow nested column types, and fix the README	2025-10-23 12:15:56 -07:00
Kenny Daniel	4715a4a429	Geospatial (#12)	2025-10-23 12:11:25 -07:00
Kenny Daniel	a56c78de39	Fix thrift encoding when delta > 15	2025-10-23 10:58:44 -07:00
Kenny Daniel	e64e66abaa	Dremel list encoding	2025-10-21 00:43:50 -07:00
Kenny Daniel	1ac0c70197	Refactor ColumnEncoder to pass around column info	2025-10-21 00:43:37 -07:00
Kenny Daniel	760a2df333	Default-only exports (#10)	2025-10-18 13:39:35 -07:00
Rens Wolters	cbe9c9e1d4	Enable exports for default imports (#9) ... * Enable exports for default imports * Fixed tests	2025-10-18 13:15:09 -07:00
Kenny Daniel	22e40cf6c4	Handle optional json columns	2025-07-28 17:06:42 -07:00
Kenny Daniel	538740f578	rowGroupSize can be an array	2025-07-04 01:43:07 -07:00
Kenny Daniel	a15bbc7eef	Update hyparquet internals	2025-07-04 01:42:55 -07:00
Kenny Daniel	5957c219bc	Allow null columns to be auto-typed	2025-05-31 23:06:17 -07:00
Kenny Daniel	9d0ab4faa8	Export node by default for better next.js support. ... Also move fileWriter into node.js file.	2025-05-31 17:33:26 -07:00
Kenny Daniel	b8227afdde	Rename ColumnData to ColumnSource	2025-05-31 16:57:00 -07:00
Kenny Daniel	791a70b983	Refactor api to support arbitrary parquet schemas (#3) ... * Refactor api to support arbitrary parquet schemas * More detail in README and error messages * Export schema tools with optional overrides * Test for basic timestamp type * Fix time-type tests * schemaFromColumnData should take an options object * Update README with schemaFromColumnData options	2025-05-09 14:47:22 -07:00
Kenny Daniel	b11b92ffb9	UUID and improved fixed length byte array support	2025-04-21 12:32:51 -07:00
Kenny Daniel	edabe74bd6	Float16	2025-04-21 11:32:13 -07:00
Kenny Daniel	4494260015	Round-trip tests	2025-04-20 23:27:01 -07:00
Kenny Daniel	5ecc4ff52e	RLE encoding for booleans	2025-04-20 22:54:03 -07:00
Kenny Daniel	263dae7101	Check for safe integers	2025-04-20 20:03:24 -07:00
Kenny Daniel	5a3d6e8d3f	Pass bitWidth to writeRleBitPackedHybrid to avoid re-scanning data	2025-04-20 19:23:44 -07:00
Kenny Daniel	de03425587	Don't write file_path, duckdb doesn't like it	2025-04-17 01:13:46 -07:00
Kenny Daniel	b92886bf16	Split out node.js exports	2025-04-17 00:38:17 -07:00
Kenny Daniel	26daec2fcb	Split out writeDataPageV2	2025-04-13 22:43:09 -07:00
Kenny Daniel	f6740aba3f	Move example data to test/example.js	2025-04-13 21:15:29 -07:00
Kenny Daniel	6226d50734	Move helpers to datapage.js	2025-04-13 17:28:49 -07:00
Kenny Daniel	070d9591b0	Fix DATE converted type	2025-04-11 19:40:17 -06:00
Kenny Daniel	fde7f81893	Fixed length byte array decimals	2025-04-11 17:51:53 -06:00
Kenny Daniel	10f23492e6	Unconvert decimal type	2025-04-11 04:38:06 -07:00
Kenny Daniel	fff0b1c6d9	Support more SchemaElement options	2025-04-11 02:50:38 -07:00
Kenny Daniel	6545196a1d	Float life	2025-04-08 04:39:58 -07:00
Kenny Daniel	5c686412c1	FileWriter	2025-04-08 03:22:30 -07:00
Kenny Daniel	41ddace347	BYO writer	2025-04-08 01:05:19 -07:00
Kenny Daniel	2bd2e396d2	Write statistics	2025-04-03 20:39:37 -07:00
Kenny Daniel	ae829f7c9b	Move convert to unconvert and test it	2025-04-03 20:31:37 -07:00
Kenny Daniel	cec00d9699	Type thrift	2025-04-03 20:13:38 -07:00
Kenny Daniel	6727628aad	rowGroupSize option	2025-04-03 00:45:43 -07:00
Kenny Daniel	3729f4cb5e	Use constants from hyparquet	2025-04-01 22:57:58 -07:00
Kenny Daniel	7be21caa9e	Option for key_value_metadata	2025-03-31 13:49:06 -07:00
Kenny Daniel	07928e8eb7	Moar tests	2025-03-31 13:32:41 -07:00
Kenny Daniel	4bf1595981	Allow specifying column type	2025-03-28 16:21:17 -07:00
Kenny Daniel	d70f727825	Dictionary encoding	2025-03-27 23:30:32 -07:00
Kenny Daniel	2e0431d815	Optional compression flag	2025-03-27 00:37:53 -07:00
Kenny Daniel	69d373ad61	Use snappy compressed pages	2025-03-27 00:01:24 -07:00
Kenny Daniel	aca7c2bde4	Fix RLE encoding bug	2025-03-26 23:59:04 -07:00
Kenny Daniel	45f3301eb8	Snappy compression	2025-03-26 23:38:25 -07:00
Kenny Daniel	c40e7c4320	Handle byte array vs string, and change parquetWrite column api	2025-03-26 01:01:04 -07:00