Allow users to upload/crawl new files only #34
Description
alephclient crawldir sends the entire directory to Aleph even if most of the content is already processed in a previous crawl. It should be possible to upload only the newer files to Aleph without uploading the rest.