Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
253 commits
Select commit Hold shift + click to select a range
20f1fe1
clean up some logging CLI.
valentinedwv Aug 29, 2022
f22a891
Choose a JsonPath parser
valentinedwv Nov 1, 2022
44534ed
Choose a JsonPath parser
valentinedwv Nov 1, 2022
4cb9cbe
Example JSON Paths and arrays of paths
valentinedwv Nov 3, 2022
671aad3
Example JSON Paths and arrays of paths
valentinedwv Nov 4, 2022
2abaa72
Update add an identifierType. aka how to generate the indentifier.
valentinedwv Nov 14, 2022
82428a3
Merge remote-tracking branch 'origin/dv_urn' into fix_124_identifiers…
valentinedwv Nov 14, 2022
53acdac
glcon tool id --idtype indentifiersha --jsonld some file
valentinedwv Nov 15, 2022
58267aa
test for #129.
valentinedwv Dec 20, 2022
fc3013d
Implemented changes to prevent context mangling
valentinedwv Dec 22, 2022
fd514a7
Implemented changes to prevent context mangling
valentinedwv Dec 22, 2022
6f2252e
Merge branch 'fix_124_identifiers_sha' of https://github.com/gleaneri…
valentinedwv Dec 22, 2022
5f9b9e6
If it's an array, we standardized.
valentinedwv Dec 23, 2022
a8df3fb
If it's an array, we standardized.
valentinedwv Dec 23, 2022
9e7b3cf
Identifiers fix for @graph
valentinedwv Jan 6, 2023
ad8dbbb
fix for empty normalized triples
valentinedwv Jan 7, 2023
2ddc8c4
add some testing to ldproc for normalization
valentinedwv Jan 7, 2023
860fc96
FIxing tests
valentinedwv Jan 7, 2023
48c7ad3
rename filesha to jsonsha, since that is what it is.
valentinedwv Jan 11, 2023
4fdbba2
implement identifierstring... add config.SourceUrl type
valentinedwv Jan 11, 2023
6dafa95
remove wifire config
valentinedwv Jan 11, 2023
b9c056b
cleanup a couple of items to use the string constants
valentinedwv Jan 11, 2023
e87cca6
add an idea example resource
valentinedwv Jan 11, 2023
9354a59
IdentiferPath is a comma separated set of strings, or one string.
valentinedwv Jan 12, 2023
c4cb39d
If you are trying not to recorder an array... and copy it, don't use …
valentinedwv Jan 12, 2023
3b806f5
Move expectations struct to a tests_common_struct file
valentinedwv Jan 13, 2023
9d35546
Merge branch 'dev' of https://github.com/gleanerio/gleaner into fix_1…
valentinedwv Jan 23, 2023
fac52c1
Update nabu dependencies during merge with dev
valentinedwv Jan 23, 2023
dad2ce2
Update nabu dependencies during merge with dev
valentinedwv Jan 23, 2023
847d5dd
added test for a couple of problem children.
valentinedwv Feb 3, 2023
a775430
methods to allow dumping data before upload
valentinedwv Feb 5, 2023
f299574
methods to allow dumping data before upload
valentinedwv Feb 5, 2023
cd9f3b9
add a couple resources for cli testing
valentinedwv Feb 5, 2023
23194b1
Merge branch 'dv_glcon_readconfig' of https://github.com/gleanerio/gl…
valentinedwv Feb 10, 2023
e6ebc51
Merge branch 'fix_124_identifiers_sha' of https://github.com/gleaneri…
valentinedwv Feb 10, 2023
0f5e79f
creating an earthcube branch to publish with fixes.
valentinedwv Feb 10, 2023
979aae1
Merge branch 'dv_glcon_readconfig' of https://github.com/gleanerio/gl…
valentinedwv Feb 14, 2023
1d83072
linux reading of config not working. Updating modules
valentinedwv Feb 14, 2023
0563fcc
Merge branch 'dv_glcon_readconfig' of https://github.com/gleanerio/gl…
valentinedwv Feb 14, 2023
9a6580c
Cleaned up tests. Files now used. (#161)
valentinedwv Feb 27, 2023
b5178da
Fix 124 identifiers tests (#162)
valentinedwv Feb 27, 2023
ddf533d
put in approvals into jsonutils
valentinedwv Feb 27, 2023
cf80469
use log.info not println so this does not show up in console output.
valentinedwv Mar 1, 2023
fae313e
test for #129.
valentinedwv Dec 20, 2022
d5b7475
Implemented changes to prevent context mangling
valentinedwv Dec 22, 2022
18bff5d
Implemented changes to prevent context mangling
valentinedwv Dec 22, 2022
9768625
Choose a JsonPath parser
valentinedwv Nov 1, 2022
c4e4675
Choose a JsonPath parser
valentinedwv Nov 1, 2022
92fd505
Example JSON Paths and arrays of paths
valentinedwv Nov 3, 2022
dee6844
Example JSON Paths and arrays of paths
valentinedwv Nov 4, 2022
3647bf1
Update add an identifierType. aka how to generate the indentifier.
valentinedwv Nov 14, 2022
6006e44
run configurations
valentinedwv Jul 25, 2022
6c41628
adding a uuid command to get uuid for a file sent to stdin.
valentinedwv Aug 20, 2022
7eb4c72
create a tools cmd
valentinedwv Aug 20, 2022
d3717a9
clean up some logging CLI.
valentinedwv Aug 29, 2022
b369387
glcon tool id --idtype indentifiersha --jsonld some file
valentinedwv Nov 15, 2022
09d4f5c
If it's an array, we standardized.
valentinedwv Dec 23, 2022
cc2dd1c
If it's an array, we standardized.
valentinedwv Dec 23, 2022
6a6b196
Identifiers fix for @graph
valentinedwv Jan 6, 2023
d1617c8
fix for empty normalized triples
valentinedwv Jan 7, 2023
4f016f2
FIxing tests
valentinedwv Jan 7, 2023
e795192
rename filesha to jsonsha, since that is what it is.
valentinedwv Jan 11, 2023
298fdc9
implement identifierstring... add config.SourceUrl type
valentinedwv Jan 11, 2023
66466e6
cleanup a couple of items to use the string constants
valentinedwv Jan 11, 2023
1492012
add an idea example resource
valentinedwv Jan 11, 2023
e093606
IdentiferPath is a comma separated set of strings, or one string.
valentinedwv Jan 12, 2023
8e8701d
If you are trying not to recorder an array... and copy it, don't use …
valentinedwv Jan 12, 2023
b273d31
Move expectations struct to a tests_common_struct file
valentinedwv Jan 13, 2023
0d670a8
Update nabu dependencies during merge with dev
valentinedwv Jan 23, 2023
19fddf7
added test for a couple of problem children.
valentinedwv Feb 3, 2023
8e6e3fb
methods to allow dumping data before upload
valentinedwv Feb 5, 2023
c7a9b53
methods to allow dumping data before upload
valentinedwv Feb 5, 2023
1c07820
add a couple resources for cli testing
valentinedwv Feb 5, 2023
e3bf70a
Cleaned up tests. Files now used. (#161)
valentinedwv Feb 27, 2023
294337f
Fix 124 identifiers tests (#162)
valentinedwv Feb 27, 2023
5e4d270
put in approvals into jsonutils
valentinedwv Feb 27, 2023
41a02c0
use log.info not println so this does not show up in console output.
valentinedwv Mar 1, 2023
4fe7a8b
sync with dev
valentinedwv Mar 3, 2023
89e3423
add approval test .approved
valentinedwv Mar 3, 2023
a8570d2
Merge remote-tracking branch 'origin/fix_124_identifiers_sha' into fi…
valentinedwv Mar 3, 2023
3b7c092
Sort the jsonpath results because UUID generation depends on order of…
valentinedwv Mar 3, 2023
073a189
One more fix for tool id. If no config is passed, just use a generic …
valentinedwv Mar 3, 2023
18306a5
One more fix for tool id. If no config is passed, just use a generic …
valentinedwv Mar 3, 2023
1b9116f
test for #129.
valentinedwv Dec 20, 2022
b0b26e3
Implemented changes to prevent context mangling
valentinedwv Dec 22, 2022
6f9ab10
Implemented changes to prevent context mangling
valentinedwv Dec 22, 2022
242ff91
Choose a JsonPath parser
valentinedwv Nov 1, 2022
32a1d17
Choose a JsonPath parser
valentinedwv Nov 1, 2022
37cbc1e
Example JSON Paths and arrays of paths
valentinedwv Nov 3, 2022
ca744f5
Example JSON Paths and arrays of paths
valentinedwv Nov 4, 2022
a931ee7
Update add an identifierType. aka how to generate the indentifier.
valentinedwv Nov 14, 2022
027bfd3
run configurations
valentinedwv Jul 25, 2022
75dfcc5
adding a uuid command to get uuid for a file sent to stdin.
valentinedwv Aug 20, 2022
e48a61a
create a tools cmd
valentinedwv Aug 20, 2022
8632a6d
clean up some logging CLI.
valentinedwv Aug 29, 2022
00c7c76
glcon tool id --idtype indentifiersha --jsonld some file
valentinedwv Nov 15, 2022
b9e0af7
If it's an array, we standardized.
valentinedwv Dec 23, 2022
3aecff3
If it's an array, we standardized.
valentinedwv Dec 23, 2022
e3ff39d
Identifiers fix for @graph
valentinedwv Jan 6, 2023
bfecd81
fix for empty normalized triples
valentinedwv Jan 7, 2023
beeec32
FIxing tests
valentinedwv Jan 7, 2023
490d29a
rename filesha to jsonsha, since that is what it is.
valentinedwv Jan 11, 2023
ff6bbd3
implement identifierstring... add config.SourceUrl type
valentinedwv Jan 11, 2023
fa54f2d
cleanup a couple of items to use the string constants
valentinedwv Jan 11, 2023
1bfd0c8
add an idea example resource
valentinedwv Jan 11, 2023
e3c41d0
IdentiferPath is a comma separated set of strings, or one string.
valentinedwv Jan 12, 2023
84d4ca8
If you are trying not to recorder an array... and copy it, don't use …
valentinedwv Jan 12, 2023
073ddcf
Move expectations struct to a tests_common_struct file
valentinedwv Jan 13, 2023
d32a991
Update nabu dependencies during merge with dev
valentinedwv Jan 23, 2023
12d6c2a
added test for a couple of problem children.
valentinedwv Feb 3, 2023
3bef4e2
methods to allow dumping data before upload
valentinedwv Feb 5, 2023
bf00c66
methods to allow dumping data before upload
valentinedwv Feb 5, 2023
bb069ad
add a couple resources for cli testing
valentinedwv Feb 5, 2023
9c0c4d7
creating an earthcube branch to publish with fixes.
valentinedwv Feb 10, 2023
648d682
linux reading of config not working. Updating modules
valentinedwv Feb 14, 2023
dd89b00
Merge branch 'fix_124_identifiers_sha' of https://github.com/gleaneri…
valentinedwv Mar 3, 2023
f7b4611
updated to latest dev
valentinedwv Mar 3, 2023
335e763
Merge remote-tracking branch 'origin/dev_ec' into dev_ec
valentinedwv Mar 3, 2023
1f425ef
fix issue with tool id where is works with a configs/local.
valentinedwv Mar 6, 2023
9a7ccd6
matrix docker container builds
valentinedwv Mar 16, 2023
8df5aee
matrix docker container builds
valentinedwv Mar 16, 2023
f389dc5
matrix docker container builds for both master and dev
valentinedwv Mar 16, 2023
c06eef7
Merge pull request #173 from gleanerio/dev_docker_dev_matrix
nein09 Mar 16, 2023
3a87406
aws region attempt. Fix was to define region in the minio.address
valentinedwv Mar 20, 2023
20a4b3a
Merge pull request #176 from gleanerio/dv_dev_175_aws_region
fils Mar 21, 2023
51fc26e
#178 fix issue where Identifier returning error (#179)
valentinedwv Mar 21, 2023
49eb7dd
Make the @id fixup work for arrays of jsonld as well
nein09 Mar 22, 2023
2ad6706
Merge pull request #181 from gleanerio/dev-mm--item-id
nein09 Mar 28, 2023
dcaee8e
#182 aws issues.
valentinedwv Apr 11, 2023
bd37161
#182 aws issues.
valentinedwv Apr 11, 2023
fe42b44
#182 aws issues.
valentinedwv Apr 11, 2023
ef65cdd
Merge branch 'dev' into dv_aws_issues
valentinedwv Apr 11, 2023
ab2fc0f
Update VERSION
valentinedwv Apr 17, 2023
1e08c39
#190 headless broken.
valentinedwv Apr 18, 2023
d95f7f8
Merge pull request #186 from gleanerio/dv_aws_issues
fils Apr 20, 2023
5549152
Merge pull request #191 from gleanerio/dev_190_broken_headless
fils Apr 20, 2023
fba5fad
removing bolt
fils Apr 20, 2023
e8efad4
removing bolt, couple more small edits
fils Apr 20, 2023
0771089
Merge pull request #194 from gleanerio/df_dev_remove_bolt
fils Apr 21, 2023
0cdcc5f
Better injection of version
valentinedwv Apr 21, 2023
49e648a
Merge branch 'dev' into dv_inject_version
valentinedwv Apr 21, 2023
4eefd73
Update VERSION
valentinedwv Apr 22, 2023
2fd50b2
#198 headless never is headless wait < 0
valentinedwv Apr 24, 2023
860b5d3
Merge pull request #196 from gleanerio/dv_inject_version
fils Apr 24, 2023
15afe79
Merge pull request #199 from gleanerio/dev_dv_198_headless_never
fils Apr 24, 2023
e8acbdf
Update VERSION
valentinedwv Apr 24, 2023
ca98838
add a couple of example jsonld files
valentinedwv Apr 28, 2023
bf19b74
gleanerViperVal no longer init'd at the root level.
valentinedwv Apr 29, 2023
62cf5d9
gleanerViperVal no longer init'd at the root level.
valentinedwv Apr 29, 2023
6952801
test case for #136
valentinedwv Apr 29, 2023
ccaa7e4
Merge pull request #204 from gleanerio/dv_fix_broken_tools
fils Apr 30, 2023
4be4266
#195 add End time, and write out after a source is complete
valentinedwv May 12, 2023
1a978ba
#195 add End time, and write out after a source is complete
valentinedwv May 13, 2023
32a6799
Merge pull request #212 from gleanerio/dev_dv_195_stats_update
fils Jun 2, 2023
7e22cc6
docker glcon
valentinedwv Jun 13, 2023
b4e441d
docker glcon with latest nabu
valentinedwv Jun 13, 2023
cc25c22
docker glcon with latest nabu
valentinedwv Jun 13, 2023
90af533
docker glcon with latest nabu
valentinedwv Jun 13, 2023
6e8534b
docker glcon with latest nabu
valentinedwv Jun 13, 2023
20c17d0
docker glcon with latest nabu
valentinedwv Jun 13, 2023
c137327
docker glcon with latest nabu
valentinedwv Jun 13, 2023
b29db78
docker glcon with latest nabu
valentinedwv Jun 13, 2023
9c94385
docker glcon with latest nabu
valentinedwv Jun 13, 2023
06ca935
docker glcon with latest nabu
valentinedwv Jun 13, 2023
4af0483
docker glcon with latest nabu
valentinedwv Jun 13, 2023
0445226
docker glcon with latest nabu
valentinedwv Jun 13, 2023
e5063a1
docker glcon with latest nabu
valentinedwv Jun 13, 2023
6ed7400
docker glcon with latest nabu
valentinedwv Jun 13, 2023
0481ac4
#174 Put issue with CDp... update to CDP 0.34.1
valentinedwv Jun 20, 2023
e5f77cf
Docker glcon
valentinedwv Jun 20, 2023
641171b
Merge pull request #214 from gleanerio/dev_174_putifx
fils Jun 20, 2023
0858ea9
Merge pull request #215 from gleanerio/dev_docker_glcon
fils Jun 20, 2023
7b4817c
add back in region for AWS and GCP
fils Jun 21, 2023
eeb7a6a
Update Gleaner configuration and add S3 and headless configurations
fils Jun 22, 2023
0ab0b97
Merge pull request #216 from gleanerio/dev--df--minio
fils Jun 22, 2023
1268c34
Docker glcon
valentinedwv Jun 22, 2023
23f9502
Merge branch 'dev' of https://github.com/gleanerio/gleaner into dev_ec
valentinedwv Jun 22, 2023
5c08532
sync with dev
valentinedwv Jun 22, 2023
4443007
add region to generate minio. update template
valentinedwv Jun 22, 2023
e01be26
Merge branch 'dev_source_loading' of https://github.com/gleanerio/gle…
valentinedwv Jun 22, 2023
1707366
add region to generate minio. update template
valentinedwv Jun 22, 2023
20a171a
Merge pull request #218 from gleanerio/dev_source_loading
fils Jun 22, 2023
c2f5576
updated to a dev_nabu
valentinedwv Jul 6, 2023
e44ad3d
docker.yml update
valentinedwv Jul 8, 2023
f304e1d
docker.yml update
valentinedwv Jul 8, 2023
77d6f09
docker.yml update
valentinedwv Jul 8, 2023
7e4c325
check for bad file.
valentinedwv Jul 8, 2023
d714da4
change docker to add version
valentinedwv Jul 8, 2023
4ea3616
change docker to add version
valentinedwv Jul 8, 2023
9ceefe8
change docker to add version
valentinedwv Jul 8, 2023
87c3726
Docker make multiple platform builds work
valentinedwv Jul 9, 2023
513d230
Docker make multiple platform builds work
valentinedwv Jul 9, 2023
eb519aa
Docker make multiple platform builds work
valentinedwv Jul 9, 2023
b1293d2
Docker make multiple platform builds work
valentinedwv Jul 9, 2023
07f3b66
Docker make multiple platform builds work
valentinedwv Jul 9, 2023
22fd415
Docker make multiple platform builds work
valentinedwv Jul 9, 2023
f744614
Docker make multiple platform builds work
valentinedwv Jul 9, 2023
9f793b2
Docker make multiple platform builds work
valentinedwv Jul 9, 2023
eb94598
add configs directory
valentinedwv Jul 10, 2023
a42a559
Merge pull request #222 from gleanerio/dev_docker_multipleimage
fils Jul 13, 2023
373394d
224 set passed source to active
valentinedwv Jul 15, 2023
c14eccc
Merge branch '224_dev_acitve_source' of https://github.com/gleanerio/…
valentinedwv Jul 17, 2023
150b372
Merge pull request #225 from gleanerio/224_dev_acitve_source
fils Jul 19, 2023
83fcb0f
Update docker_gleaner.yml
valentinedwv Jul 19, 2023
6a4d814
Update docker_glcon.yml
valentinedwv Jul 19, 2023
49aba64
Merge branch 'dev' of https://github.com/gleanerio/gleaner into dev_ec
valentinedwv Jul 19, 2023
2b0a938
update to googledrive and identifier for identifierstring creation fr…
valentinedwv Jul 26, 2023
3065171
fix bad return codes
valentinedwv Jul 31, 2023
9a90315
Merge branch '232_dev' of https://github.com/gleanerio/gleaner into d…
valentinedwv Jul 31, 2023
6ad5cb9
Merge branch 'dev_indentiifer_arks' of https://github.com/gleanerio/g…
valentinedwv Jul 31, 2023
256a703
AcceptContentTypes per source, Fix isValidJson issue with arrays (#206)
valentinedwv Aug 31, 2023
51689f3
multi-threading headless has issues. Not working, but it's in page re…
valentinedwv Sep 6, 2023
9892bae
multi-threading headless has issues. Not working, but it's in page re…
valentinedwv Sep 6, 2023
b9e18d3
multi-threading headless has issues. kinda working , but it's in page…
valentinedwv Sep 6, 2023
3ecffda
multi-threading headless has issues. kinda working , but it's in page…
valentinedwv Sep 6, 2023
dd64537
multi-threading headless has issues. kinda workingadd some runconfigu…
valentinedwv Sep 6, 2023
67a2b5b
fix indentifier generation.
valentinedwv Sep 8, 2023
2f2c0ca
fix tests
valentinedwv Sep 8, 2023
02601d5
add some details on when a loadevents and domcontent fails
valentinedwv Sep 11, 2023
6fc0773
Merge branch 'dev' into dev_ec
valentinedwv Sep 11, 2023
eeb7726
Merge branch '239_dev_headless' into dev_ec
valentinedwv Sep 11, 2023
d218059
dev_ec verison with headless mods and contiuous logging
valentinedwv Sep 11, 2023
11809d3
fix issue with identifier string generation.
valentinedwv Sep 28, 2023
2a0f048
Merge branch 'dev_indentiifer_arks' of https://github.com/gleanerio/g…
valentinedwv Sep 28, 2023
70deb9d
user agent notes.
valentinedwv Oct 13, 2023
510aacd
Headless wait was always reset to >=.. whereas -1 is no headless
valentinedwv Jun 20, 2024
a21838a
action updates
valentinedwv Jun 20, 2024
3de7067
Merge pull request #231 from gleanerio/dev_indentiifer_arks
fils Jul 3, 2024
0b89b49
Log when headless is disabled
valentinedwv Jul 3, 2024
cf3dcf1
fix logging format
valentinedwv Aug 6, 2024
b19fa17
Add support for loading configuration from a URL
fils Sep 19, 2024
eec321b
#138 apply buffer increase from nabu code
valentinedwv Oct 15, 2024
19e4438
Add cfgURL flag and sanitize localConfig.yaml
fils Nov 15, 2024
135f5bb
Update config flag names and add new dependencies
fils Nov 15, 2024
8a0402a
Merge branch '239_dev_headless' of https://github.com/gleanerio/glean…
valentinedwv Nov 15, 2024
892e371
Merge branch 'dev_df_httpConfig' of https://github.com/gleanerio/glea…
valentinedwv Nov 15, 2024
44c7175
update nabu reference
valentinedwv Nov 15, 2024
ee21d93
version
valentinedwv Nov 15, 2024
6f0b746
gomod
valentinedwv Nov 15, 2024
e32c267
add branches to CI
valentinedwv Aug 1, 2025
ca7a9d9
clean string inentifiers
valentinedwv Aug 1, 2025
623086d
Merge branch 'fix/identifiers_cleaning' into dev_ec
valentinedwv Aug 1, 2025
59c00b1
update workflow version
valentinedwv Aug 1, 2025
29ca1ac
Merge branch 'dev' of https://github.com/gleanerio/gleaner into dev_ec
valentinedwv Aug 1, 2025
e3baf05
update workflow version
valentinedwv Aug 1, 2025
4f1517a
update workflow version
valentinedwv Aug 1, 2025
099b93c
update workflow version
valentinedwv Aug 1, 2025
fc8ed1e
update workflow version
valentinedwv Aug 1, 2025
4d6979e
update workflow version
valentinedwv Aug 1, 2025
ce648e3
update workflow version
valentinedwv Aug 1, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
24 changes: 14 additions & 10 deletions .github/workflows/docker-dev.yml
Original file line number Diff line number Diff line change
@@ -1,8 +1,12 @@
name: Dockerize Gleaner - Development Branch
name: Go Binary - Development Branch
on:
push:
branches:
- master
- dev
- dev_ec
- feature/*
- fix/*
release:
types: [published]

Expand All @@ -25,9 +29,9 @@ jobs:
goos: darwin
steps:
- name: Install Go
uses: actions/setup-go@v2
uses: actions/setup-go@v4
- name: checkout code
uses: actions/checkout@v2
uses: actions/checkout@v4
- name: donwload schema
run: curl https://schema.org/version/latest/schemaorg-current-https.jsonld --output assets/schemaorg-current-https.jsonld
- name: donwload schema
Expand All @@ -41,8 +45,8 @@ jobs:
go build -o gleaner
working-directory: ./cmd/gleaner
env:
GOOS: linux
GOARCH: amd64
GOOS: ${{matrix.goss}}
GOARCH: ${{matrix.goarch}}
CGO_ENABLED: 0
# deploy:
# needs: build
Expand All @@ -52,13 +56,13 @@ jobs:
# - name: Checkout Repo
# uses: actions/checkout@v2
- name: Set up QEMU
uses: docker/setup-qemu-action@v2
uses: docker/setup-qemu-action@v3
with:
platforms: 'arm64,arm'
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v1
uses: docker/setup-buildx-action@v3
- name: Login to DockerHub
uses: docker/login-action@v2
uses: docker/login-action@v3
with:
username: ${{ secrets.DOCKERHUB_USERNAME }}
password: ${{ secrets.DOCKERHUB_TOKEN }}
Expand All @@ -68,7 +72,7 @@ jobs:
echo "VERSION=$VER" >> $GITHUB_ENV
- name: Extract metadata (tags, labels) for Docker
id: meta
uses: docker/metadata-action@v3
uses: docker/metadata-action@v5
with:
images: nsfearthcube/gleaner
flavor: |
Expand All @@ -80,7 +84,7 @@ jobs:
type=semver,pattern={{version}}
- name: Build and push
id: docker_build
uses: docker/build-push-action@v3
uses: docker/build-push-action@v6
with:
push: true
platforms: linux/amd64,linux/arm64
Expand Down
90 changes: 0 additions & 90 deletions .github/workflows/docker.yml

This file was deleted.

178 changes: 178 additions & 0 deletions .github/workflows/docker_glcon.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,178 @@
name: Dockerize glcon gleaner console
# need to look at this to do it right
# https://namiops.medium.com/golang-multi-arch-docker-image-with-github-action-b59a62c8d2bd
on:
push:
branches:
- master
- dev_docker_glcon
- dev
- dev_ec
- feature/*
- fix/*
tags:
- v3.*
release:
types: [published]

# https://github.com/marketplace/actions/publish-docker
# https://github.com/docker/build-push-action
env:
REGISTRY_IMAGE: nsfearthcube/glcon
jobs:
build:
name: Docker glcon
runs-on: ubuntu-latest

strategy:
matrix:
include:
- goarch: amd64
goos: "linux"
platform: linux/amd64
- goarch: arm64
goos: "linux"
platform: linux/arm64

# above is explict build lists, otherwise we get amd64 on linux/arm as an option

# build and publish in parallel: linux/amd64
#goos: [linux, windows, darwin]
#goarch: [amd64,arm64]
# goos: [linux]
# goarch: [amd64, arm64]
# platform: [linux/amd64,linux/arm64]
# exclude:
# - goarch: "386"
# goos: darwin
steps:
- name: Install Go
uses: actions/setup-go@v5
- name: checkout code
uses: actions/checkout@v4
- name: donwload schema
run: curl https://schema.org/version/latest/schemaorg-current-https.jsonld --output assets/schemaorg-current-https.jsonld
- name: donwload schema
run: curl https://schema.org/version/latest/schemaorg-current-http.jsonld --output assets/schemaorg-current-http.jsonld

# - name: Run tests
# run: go test -v -p=1 -timeout=0 ./...
- id: binary
name: build
run: |
go build -o glcon
working-directory: ./cmd/glcon
env:
GOOS: ${{matrix.goss}}
GOARCH: ${{matrix.goarch}}
CGO_ENABLED: 0
# deploy:
# needs: build
# name: Dockerize Gleaner
# runs-on: ubuntu-latest
# steps:
# - name: Checkout Repo
# uses: actions/checkout@v2
- name: Set up QEMU
uses: docker/setup-qemu-action@v3
with:
platforms: ${{matrix.goarch}}
- name: Set up Docker Buildx
uses: docker/setup-buildx-action@v3
- name: Login to DockerHub
uses: docker/login-action@v3
with:
username: ${{ secrets.DOCKERHUB_USERNAME }}
password: ${{ secrets.DOCKERHUB_TOKEN }}
- name: Extract metadata (tags, labels) for Docker
id: meta
uses: docker/metadata-action@v5
with:
images: ${{ env.REGISTRY_IMAGE }}
flavor: |
latest=true
tags: |
type=ref,event=tag
type=ref,event=branch
type=semver,pattern={{version}}

- name: Build and push
id: build
uses: docker/build-push-action@v6
with:
#push: true
platforms: ${{ matrix.platform }}
#platforms: linux/amd64,linux/arm64
# tags: ${{ steps.meta.outputs.tags }}
labels: ${{ steps.meta.outputs.labels }}
file: ./build/Dockerfile_glcon
context: .
outputs: type=image,name=${{ env.REGISTRY_IMAGE }},push-by-digest=true,name-canonical=true,push=true

# - name: Image digest
# run: echo ${{ steps.build.outputs.digest }}
- name: Export digest
run: |
mkdir -p /tmp/digests
digest="${{ steps.build.outputs.digest }}"
touch "/tmp/digests/${digest#sha256:}"
- name: Upload digest
uses: actions/upload-artifact@v4
with:
name: digests-${{ matrix.goarch }}
path: /tmp/digests/*
if-no-files-found: error
retention-days: 1
merge:
runs-on: ubuntu-latest
needs:
- build
strategy:
matrix:
include:
- goarch: amd64
goos: "linux"
platform: linux/amd64
- goarch: arm64
goos: "linux"
platform:
linux/arm64
steps:

- name: Download digests
uses: actions/download-artifact@v4
with:
name: digests-${{ matrix.goarch }}
path: /tmp/digests
-
name: Set up Docker Buildx
uses: docker/setup-buildx-action@v3
-
name: Docker meta
id: meta
uses: docker/metadata-action@v5
with:
images: ${{ env.REGISTRY_IMAGE }}
flavor: |
latest=true
tags: |
type=ref,event=tag
type=ref,event=branch
type=semver,pattern={{version}}

-
name: Login to Docker Hub
uses: docker/login-action@v3
with:
username: ${{ secrets.DOCKERHUB_USERNAME }}
password: ${{ secrets.DOCKERHUB_TOKEN }}
-
name: Create manifest list and push
working-directory: /tmp/digests
run: |
docker buildx imagetools create $(jq -cr '.tags | map("-t " + .) | join(" ")' <<< "$DOCKER_METADATA_OUTPUT_JSON") \
$(printf '${{ env.REGISTRY_IMAGE }}@sha256:%s ' *)
-
name: Inspect image
run: |
docker buildx imagetools inspect ${{ env.REGISTRY_IMAGE }}:${{ steps.meta.outputs.version }}
Loading
Loading