Go to your app services > Configuration > Timezone.
Edit the timezone to something you like: Europe/Amsterdam
Save the settings and restart your app services. Beware: Your schedules that are already present will still be using the old timezone.
Just restart the App Service, the App Service will pull the latest image upon reboot and update itself.
Make sure that your "Deployment Template" on the App Service matches what is in the docker-compose-azure.yml file.