feat: chunked processing (streaming) #416

Job	Run time
generate (legacy-json, ./node/doc/api/*.md)	36s
generate (json-simple, ./node/doc/api/*.md)	47s
generate (api-links, ./node/lib/*.js)	36s
generate (man-page, ./node/doc/api/cli.md)	32s
generate (addon-verify, ./node/doc/api/addons.md)	35s
generate (web, ./node/doc/api/*.md)	55s
generate (orama-db, ./node/doc/api/*.md)	41s
generate (llms-txt, ./node/doc/api/*.md)	46s
generate (legacy-html, ./node/doc/api/*.md)	44s
	6m 12s

Provide feedback