Migrate to Github Action

Author: benjben

.github/workflows/lib/yaml_to_json.py

@@ -0,0 +1,30 @@
+#!/bin/bash
+
+# PROPRIETARY AND CONFIDENTIAL
+#
+# Unauthorized copying of this project via any medium is strictly prohibited.
+#
+# Copyright (c) 2020-2020 Snowplow Analytics Ltd. All rights reserved.
+
+# Generate the JSON equivalent of the yaml file with the list of referers
+
+import sys
+import json
+import yaml
+
+if len(sys.argv) != 3:
+    print 'USAGE: yaml_to_json.py <input_referers.yaml> <output_referers.json>'
+    print '2 arguments must be specified'
+    print 'Arguments:'
+    print sys.argv[1:]
+    sys.exit(1)
+
+input_yaml = sys.argv[1]
+output_json = sys.argv[2]
+
+referers = yaml.load(open(input_yaml))
+json = json.dumps(referers, sort_keys = False, indent = 4)
+
+print "writing to {0} ".format(output_json)
+with open(output_json, 'w') as f:
+    f.write(json)

.github/workflows/test.yml

@@ -0,0 +1,17 @@
+name: test
+
+on: pull_request
+
+jobs:
+  test:
+    runs-on: ubuntu-latest
+    steps:
+      steps:
+        - uses: actions/checkout@v3
+        - uses: actions/setup-python@v4
+          with:
+            python-version: '3.10' 
+      - name: Convert yaml to json
+        run: python .github/workflows/lib/yaml_to_json.py resources/referers.yml referers.json
+      - name: Check
+        run: ls

.gitignore

@@ -17,17 +17,16 @@ The latest database is always available on this URL:
 https://s3-eu-west-1.amazonaws.com/snowplow-hosted-assets/third-party/referer-parser/referers-latest.yaml
 https://s3-eu-west-1.amazonaws.com/snowplow-hosted-assets/third-party/referer-parser/referers-latest.json
 
-The database is updated at most once a month. Each new version of the database is also uploaded with a timestamp:
+The database is updated every day. Each new version of the database is also uploaded with a timestamp:
 
 https://s3-eu-west-1.amazonaws.com/snowplow-hosted-assets/third-party/referer-parser/referers-YYYYMMDD.yaml
 https://s3-eu-west-1.amazonaws.com/snowplow-hosted-assets/third-party/referer-parser/referers-YYYYMMDD.json
 
 Example:
+
 https://s3-eu-west-1.amazonaws.com/snowplow-hosted-assets/third-party/referer-parser/referers-20200331.yaml
 https://s3-eu-west-1.amazonaws.com/snowplow-hosted-assets/third-party/referer-parser/referers-20200331.json
 
-If there is an issue with the database necessitating a re-release within the month, the corresponding files will be overwritten.
-
 ## Language-specific repositories
 
 - Scala: https://github.com/snowplow-referer-parser/scala-referer-parser
@@ -78,9 +77,7 @@ We welcome contributions to referer-parser:
 
 ## Support
 
-General support for referer-parser is handled by the team at Snowplow Analytics Ltd.
-
-You can contact the Snowplow Analytics team through any of the [channels listed on their wiki][talk-to-us].
+General support for `referer-parser` is handled by Snowplow Analytics team on [discourse][discourse].
 
 ## Copyright and license
 
@@ -90,6 +87,8 @@ You can contact the Snowplow Analytics team through any of the [channels listed
 
 [snowplow]: https://github.com/snowplow/snowplow
 
+[discourse]: https://discourse.snowplow.io
+
 [piwik]: http://piwik.org
 [piwik-search-engines]: https://github.com/piwik/piwik/blob/master/core/DataFiles/SearchEngines.php
 [piwik-socials]: https://github.com/piwik/piwik/blob/master/core/DataFiles/Socials.php