You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@@ -145,11 +145,32 @@ You can also query the service API with:
145
145
curl http://localhost:4000
146
146
```
147
147
148
+
### Additional Setup for GitHub curation(Optional)
149
+
150
+
If you want to work with curation on GitHub, you could follow these steps
151
+
1. Fork [curated-data-dev](https://github.com/clearlydefined/curated-data-dev) into your own GitHub account and modify the .env file.
152
+
```
153
+
CURATION_GITHUB_OWNER="<your own GitHub account>"
154
+
CURATION_GITHUB_REPO="curated-data-dev"
155
+
```
156
+
2. In order to get GitHub webhook events, a http forwarding proxy is needed. Here [ngork](https://ngrok.com/download) has been used. Run `ngork http http://localhost:4000`. You will see something similar to this
3. Then you could create a webhook in your forked curate-data repository. Use ngork forwarding url(prefer https one) as the webhook payload URL. And put 'secret' as the webhook secret.
167
+
4. You could verify Github webhook events with `ngork` management UI, http://localhost:4040
168
+
148
169
## What You're Running
149
170
150
171
Now, let's go through what your are running, container by container.
151
172
152
-
* Clearly Defined Website
173
+
* Clearly Defined Website
153
174
* Clearly Defined Service
154
175
* Clearly Defined Crawler
155
176
* Clearly Defined Mongo DB
@@ -161,7 +182,7 @@ This is the Clearly Defined React UI. It's what you see when you open your brows
161
182
162
183
### Clearly Defined Service
163
184
164
-
This is the backend of Clearly Defined, you can use it through the Website UI or through
185
+
This is the backend of Clearly Defined, you can use it through the Website UI or through
165
186
querying it directly through the command line.
166
187
167
188
Any Clearly Defined environment needs a place to store raw harvest information. In the case of this development environment, we use the file store for storing harvest information (our production setup uses Azure blob storage).
@@ -265,18 +286,18 @@ $ docker-compose up --detach --build crawler
265
286
266
287
### Limitations
267
288
268
-
When you look at a definition in the UI and create a curation (this uses the API call PATCH /curations), the curation WILL be opened
289
+
When you look at a definition in the UI and create a curation (this uses the API call PATCH /curations), the curation WILL be opened
269
290
as a pull request on the [curated-data-dev](https://github.com/clearlydefined/curated-data-dev), but you will not see it
270
291
under the "Curations" section when you refresh the definition's page.
271
292
272
293
In the Azure dev and production environment, creating a curation will open a PR on the appropriate github curated-data repo,
273
294
and then, once the pull request is open, GitHub will then use a webhook.
274
295
275
-
The webhook will POST to an Azure logic app. That app will then put the curation on the Azure storage queue, which is how it will
296
+
The webhook will POST to an Azure logic app. That app will then put the curation on the Azure storage queue, which is how it will
276
297
end up in the curation store (in this case, mongo).
277
298
278
-
I haven't yet figured out a way to do this without an Azure logic app (but will continue looking into this). I did try
279
-
creating a GitHub webhook to POST to http://localhost:4000, but GitHub requires that the webhooks it POSTs to be
299
+
I haven't yet figured out a way to do this without an Azure logic app (but will continue looking into this). I did try
300
+
creating a GitHub webhook to POST to http://localhost:4000, but GitHub requires that the webhooks it POSTs to be
280
301
accessible over the public internet.
281
302
282
303
When I figure out a solution, I will update this README.
0 commit comments