restore db tables : batch multi thread issue

[yunw]

Hi while I am using this tool to do the restore multiple tables, only the first table restore succeed and then fall into the infinite loop with the message:

Error processing batch, putting back in the queue.
Batch sent. 1 in flight. 0Kb remaining to download...

I am using the command tool, and this is the snippit:

restore_tables() {
    cd bin
    aws s3 ls $S3_RESTORE_LOC | awk '{print $4}' | while read tablenamejson; do
        tablename=$(echo $tablenamejson | cut -d'.' -f1)
        tablesize=$(aws s3 ls $S3_RESTORE_LOC$tablenamejson | awk '{print $3}')
        if [[ $tablesize -eq 0 ]]; then
            echo "table size is 0. skip restore $tablename"
        else
            ./dynamo-restore-from-s3 -s "$S3_RESTORE_LOC$tablenamejson" -t "$tablename" --overwrite \
                --aws-key "$AWS_KEY" --aws-secret "$AWS_SECRET" --aws-region "$REGION_NAME"

            sleep 1 ### even with sleep, it didn't go to this step
            read -r -p "Press any key to continue" ### not go to this step yet while inifitite loop happens
        fi
    done
}

do you have the issue? and how to resolve ... ?

appreciated!