incremental refresh for large folders #17106
Description
I have some folders in S3 that contain 50k+ objects. It takes a while to download the full listing, and if new objects have been added I have to click "refresh" which will download the full listing and again take some time.
It would be nice if there was an alternative to "refresh" that would assume the keys are ordered and quickly check for new items by specifying the start-after parameter to S3ListObjectsV2 passing the last key. Ideally we could configure this to happen automatically/quietly in the background every couple of seconds so that new items would just appear.