Base32 encoded sha1 examples

[jukuisma]

There are 50 base32 encoded sha1 examples in the specs:

vagrant@almalinux ~/github/warc-specifications (master)
$ for i in (git grep -EIo 'sha1:[A-Z0-9]{32}' | awk -F : '{print $NF}')
      echo $i
  end | wc -l
50

of which 16 aren't valid base32:

vagrant@almalinux ~/github/warc-specifications (master)
$ for i in (git grep -EIo 'sha1:[A-Z0-9]{32}' | awk -F : '{print $NF}')
      echo $i | base32 -d > /dev/null
  end
base32: invalid input
base32: invalid input
base32: invalid input
base32: invalid input
base32: invalid input
base32: invalid input
base32: invalid input
base32: invalid input
base32: invalid input
base32: invalid input
base32: invalid input
base32: invalid input
base32: invalid input
base32: invalid input
base32: invalid input
base32: invalid input

Not super crucial, but did cause some confusion. Partly related to this issue: nlnwa/gowarc#90.

Cheers, Juho

[vpv-csc]

This is basically the same issue as #64 but @jukuisma found even more of these errors.

I modified Juho's loop a bit and made it bash-compatible. With this you can see where the erroneous checksums are in the MD files:

git grep -Eno 'sha1:[A-Z0-9]{32}' -- '*.md' |
while IFS= read -r x; do
    file=$(echo "$x" | cut -d: -f1)
    lineno=$(echo "$x" | cut -d: -f2)
    token=$(echo "$x" | cut -d: -f3-)

    b32=$(echo "$token" | cut -d: -f2)

    if ! echo -n "$b32" | base32 -d >/dev/null 2>&1; then
        echo "$file:$lineno: $token"
    fi
done

I noticed you have added some community errata in f9bba88

If I only concentrate on the community annotated version, there are still these cases left in the examples:

specifications/warc-format/warc-1.1-annotated/index.md:1758: sha1:DBXHDRBXLF4OMUZ5DN4JJ2KFUAOB6VK8
specifications/warc-format/warc-1.1-annotated/index.md:1759: sha1:DBXHDRBXLF4OMUZ5DN4JJ2KFUAOB6VK8
specifications/warc-format/warc-1.1-annotated/index.md:1795: sha1:VXT4AF5BBZVHDYKNC2CSM8TEAWDB6CH8
specifications/warc-format/warc-1.1-annotated/index.md:1903: sha1:T7HXETFVA92MSS7ZENMFZY6ND6WF7KB7