[IMPORTANT] Dynamic sidecar changing permission issue

[matusdrobuliak66]

• We identified an issue that will affect the logic with EBS keeping it up (for fast startup). The dynamic sidecar is always changing permissions for all files at the start. Until now, this was typically done for an empty volume. However, if there is data with many files, and it doesn’t manage to change permissions within 1 minute, the Docker health check will kill it and prevent the sidecar from starting.

### Tasks
- [x] Bump healthcheck for dynamic sidecar after checkinng current usage @matusdrobuliak
- [ ] ~~Used the same user of service inside of sidecar entrypoint sh @GitHK~~

[sanderegg]

I think we need to get an overview of what goes on when a dynamic sidecar starts:

• What permissions are changed where (service, sidecar, etc), to what values, we need the full information (from docker swarm creating the volumes, sidecar changing the permissions to be able to access them, then whatever the services are doing)

In my ideal world:

• the service shall not run as root,
• the service should never touch any permission,
• the sidecar shall set the permission as needed, that means that on restart the sidecar does not need to change these again

[GitHK]

Summary for Event Horizon sprint

Done

• Fixed issue where the verbose flag was causing the sidecar to take up to (at least) 3 orders of magnitude more to change permissions 🐛 Making dy-sidecar start faster when volumes contain data #6886