Migrate to Github Action

Author: benjben

.github/workflows/lib/yaml_to_json.py

@@ -0,0 +1,9 @@
+import sys
+import yaml
+import json
+
+with open(sys.argv[1], 'r') as input:
+    yml = yaml.safe_load(input)
+
+with open(sys.argv[2], 'w') as output:
+    json.dump(yml, output)

.github/workflows/publish_test_json.yml

@@ -0,0 +1,24 @@
+name: release
+
+on:
+  push:
+    tags:
+      - test*
+
+jobs:
+  release:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v3
+      - name: Convert yaml to json
+        run: python .github/workflows/lib/yaml_to_json.py resources/referers.yml referers.json
+      - name: Get datetime
+        id: datetime
+        run: echo "datetime=$(date "+%Y-%m-%d-%H%M%S")" >> $GITHUB_OUTPUT
+      - name: Tag
+        run: git tag ${{ steps.datetime.outputs.datetime }} && git push --tags
+      - name: Create GitHub release and attach referers.json
+        uses: softprops/action-gh-release@v1
+        with:
+          tag_name: ${{ steps.datetime.outputs.datetime }}
+          files: ./referers.json

.github/workflows/release.yml

@@ -0,0 +1,24 @@
+name: release
+
+on:
+  push:
+    branches:
+      - master
+
+jobs:
+  release:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v3
+      - name: Get date
+        id: date
+        run: echo "date=$(date "+%Y%m%d")" >> "$GITHUB_ENV"
+      - name: Convert yaml to json
+        run: python .github/workflows/lib/yaml_to_json.py resources/referers.yml referers-${{ steps.date.outputs.date }}.json
+      - name: Tag
+        run: git tag ${{ steps.date.outputs.datetime }} && git push --tags
+      - name: Create GitHub release and attach referers.json
+        uses: softprops/action-gh-release@v1
+        with:
+          tag_name: ${{ steps.date.outputs.date }}
+          files: ./referers-${{ steps.date.outputs.date }}.json

.github/workflows/test.yml

@@ -0,0 +1,13 @@
+name: test
+
+on: pull_request
+
+jobs:
+  test:
+    runs-on: ubuntu-latest
+    steps:
+      - uses: actions/checkout@v3
+      - name: Convert yaml to json
+        run: python .github/workflows/lib/yaml_to_json.py resources/referers.yml referers.json
+      - name: Check
+        run: cat referers.json

.gitignore

@@ -17,17 +17,16 @@ The latest database is always available on this URL:
 https://s3-eu-west-1.amazonaws.com/snowplow-hosted-assets/third-party/referer-parser/referers-latest.yaml
 https://s3-eu-west-1.amazonaws.com/snowplow-hosted-assets/third-party/referer-parser/referers-latest.json
 
-The database is updated at most once a month. Each new version of the database is also uploaded with a timestamp:
+The database is updated every day. Each new version of the database is also uploaded with a timestamp:
 
 https://s3-eu-west-1.amazonaws.com/snowplow-hosted-assets/third-party/referer-parser/referers-YYYYMMDD.yaml
 https://s3-eu-west-1.amazonaws.com/snowplow-hosted-assets/third-party/referer-parser/referers-YYYYMMDD.json
 
 Example:
+
 https://s3-eu-west-1.amazonaws.com/snowplow-hosted-assets/third-party/referer-parser/referers-20200331.yaml
 https://s3-eu-west-1.amazonaws.com/snowplow-hosted-assets/third-party/referer-parser/referers-20200331.json
 
-If there is an issue with the database necessitating a re-release within the month, the corresponding files will be overwritten.
-
 ## Language-specific repositories
 
 - Scala: https://github.com/snowplow-referer-parser/scala-referer-parser
@@ -78,9 +77,7 @@ We welcome contributions to referer-parser:
 
 ## Support
 
-General support for referer-parser is handled by the team at Snowplow Analytics Ltd.
-
-You can contact the Snowplow Analytics team through any of the [channels listed on their wiki][talk-to-us].
+General support for `referer-parser` is handled by Snowplow Analytics team on [discourse][discourse].
 
 ## Copyright and license
 
@@ -90,6 +87,8 @@ You can contact the Snowplow Analytics team through any of the [channels listed
 
 [snowplow]: https://github.com/snowplow/snowplow
 
+[discourse]: https://discourse.snowplow.io
+
 [piwik]: http://piwik.org
 [piwik-search-engines]: https://github.com/piwik/piwik/blob/master/core/DataFiles/SearchEngines.php
 [piwik-socials]: https://github.com/piwik/piwik/blob/master/core/DataFiles/Socials.php