AsyncIterator version of local API

[tyteen4a03]

I would like to be able to effortlessly loop over all documents in a collection with the local API, without worrying about pagination.

EDIT: here's a quick and dirty one in the meantime:

import payload, { GeneratedTypes } from "payload";
import { Options as FindOptions } from "payload/dist/collections/operations/local/find";

export async function* findAllIter<T extends keyof GeneratedTypes["collections"]>(options: FindOptions<T>) {
    let next = 1;
    let hasNextPage = true;

    do {
        console.log(`Fetching page ${next}`);
        const result = await payload.find({
            ...options,
            page: next,
        });
        for (const doc of result.docs) {
            yield doc;
        }

        next = result.nextPage;
        hasNextPage = result.hasNextPage;
    } while (hasNextPage);
}

[r1tsuu]

Isn't that what you want?

// with pagination false it returns all docs.
 const { docs } = await payload.find({ collection: 'test', pagination: false });

// in parallel 
 await Promise.all(
    docs.map(async (doc) => {
      console.log(doc);
      await doSomeTask(doc);
    }),
  );

// sync
for (const doc of docs) {
    console.log(doc)
  }

[tyteen4a03]

No, because it loads everything into memory with pagination: false and would cause some of my workloads to go OOM.