Feature/enhance migration

[lindenmckenzie]

What

Added some quality of life changes for migration stack:

• reset zebedee collections
• add dis-design-system-go
• enable audit logging
• add slack integration variables
• add permissions api to the dp-api-router manifest

How to review

You can run the stack with the example dataset and try looking at:

• view the migrated dataset via the dp-frontend-dataset-controller
• use the slack integration by getting the OAuth token from the migration service app in slack
• check the audit logging happening in via the /migration-jobs/{jobNumber}/events endpoint.

reset collection requires changes to the dis-migration-service that are currently on a branch: ONSdigital/dis-migration-service#64

Who can review

Not me.

[cookel2]

The syntax looks good to me. But I haven't been very successful with trying to run the stack so far. Whether I use make up or make up-with-seed I always get these log messages in the migration service (despite having tried following all the prerequisites for the topics too): - failed as unexpected code from topic api: 404

• failed to get root topic from topic-api
• initial topic cache population failed - no topics were loaded
• failed to initialise topic cache
• running service failed: initial topic cache population failed - no topics were loaded

[lindenmckenzie]

@cookel2 you may need to restart the dis-migration-service after the topic seeding script is run.

[cookel2]

I've had another try and managed to get the stack running healthily with the topics seeded this time. However, I did have to refresh the migration service (as advised). But then when I tried running the first POST request to localhost:30100/v1/migration-jobs it gave me a 403 Forbidden error with this message: "data": {
"permission": "migrations:create"
},
"event": "permission not found in permissions bundle",
"namespace": "dis-migration-service",

[cookel2]

A couple of comments on the readme. But also I get a "source ID is invalid" error, with a 400 code, when I try calling localhost:30100/v1/migration-jobs. I noticed that the source ID contains a repetition of the words "labourdisputes" in datasets/labourdisputeslabourdisputesannualestimates but when I tried removing the duplication it still gave me the same error.

[cookel2]

This make command and the other ones in this readme all have leading spaces that it would be useful to remove.

[lindenmckenzie]

Have reformatted a bunch of things.

[cookel2]

It works for me now, thanks