Added URL checker (#11)

* Added URL checker

Author: Denis-Averin

.github/workflows/check-urls.yml

@@ -0,0 +1,25 @@
+name: CI
+
+# Controls when the action will run. Triggers the workflow on push or pull request
+# events but only for the master branch
+on:
+  push:
+    branches: [ master ]
+  pull_request:
+    branches: [ master ]
+
+# A workflow run is made up of one or more jobs that can run sequentially or in parallel
+jobs:
+  # This workflow contains a single job called "build"
+  build:
+    # The type of runner that the job will run on
+    runs-on: ubuntu-latest
+
+    # Steps represent a sequence of tasks that will be executed as part of the job
+    steps:
+    # Checks-out your repository under $GITHUB_WORKSPACE, so your job can access it
+    - uses: actions/checkout@v2
+
+    # Check all urls in Markdown files
+    - name: Check all URLs
+      run: ./scripts/check_all_urls.sh

README.md

@@ -65,7 +65,7 @@ Postnet, Planet, USPS OneCode, Australia Post, Deutsche Post Identcode, Deutsche
 
 ## Prerequisites
 
-To use Aspose Barcode Cloud for Android you need to register an account with [Aspose Cloud](https://www.aspose.cloud/) and lookup/create Client Secret and SID at [Cloud Dashboard](https://dashboard.aspose.cloud/applications). There is free quota available. For more details, see [Aspose Cloud Pricing](https://purchase.aspose.cloud/pricing).
+To use Aspose Barcode Cloud for Android you need to register an account with [Aspose Cloud](https://www.aspose.cloud) and lookup/create Client Secret and SID at [Cloud Dashboard](https://dashboard.aspose.cloud/applications). There is free quota available. For more details, see [Aspose Cloud Pricing](https://purchase.aspose.cloud/pricing).
 
 ## Getting Started
 

scripts/check-urls-in-file.py

@@ -0,0 +1,49 @@
+import re
+import subprocess
+import os
+import sys
+import fileinput
+import collections
+
+URL_REGEX = re.compile(r"""(http[s]*://[^{})"'<>#\s]+)[)"'<>#\s]""")
+
+GOOD_URLS = set('https://www.aspose.cloud',)
+BROKEN_URLS = collections.defaultdict(list)
+
+
+def check_url(url):
+    with open(os.devnull, 'w') as devnull:
+        ret_code = subprocess.call(['curl', '-sSf', '--user-agent', 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:91.0) Gecko/20100101 Firefox/91.0', url], stdout=devnull)
+    return ret_code == 0
+
+
+def check_file(filename):
+    with open(filename, 'r') as f:
+        urls = frozenset(URL_REGEX.findall(f.read()))
+
+    for url in sorted(urls):
+        if url in GOOD_URLS:
+            continue
+        elif url in BROKEN_URLS:
+            continue
+
+        if check_url(url):
+            print("OK: '%s'" % url)
+            GOOD_URLS.add(url)
+        else:
+            print("BROKEN: '%s' in file %s" % (url, filename))
+            BROKEN_URLS[url].append(filename)
+
+
+def main():
+    for filename in fileinput.input():
+        check_file(filename.strip())
+
+    for url, files in BROKEN_URLS.items():
+        print("BROKEN URL: '%s' in files: %s" % (url, ', '.join(files)), file=sys.stderr)
+    if BROKEN_URLS:
+        exit(1)
+
+
+if __name__ == '__main__':
+    main()

scripts/check_all_urls.sh

@@ -0,0 +1,11 @@
+#!/bin/bash
+
+set -euo pipefail
+
+SCRIPT_DIR="$( cd "$( dirname "${BASH_SOURCE[0]}" )" &> /dev/null && pwd )"
+
+check_file () {
+    echo "$1"
+}
+
+git ls-files --exclude-standard --full-name | grep -i '\.md$\|\.kt$' | python "${SCRIPT_DIR}/check-urls-in-file.py"