Authorizer refresh times may be too tight for production scenarios

These numbers may be a bit tight - worst case, you're going to refresh 1 minute before the token expires.

_Originally posted by @LarryOsterman in https://github.com/Azure/azure-sdk-for-rust/pull/2863#discussion_r2288835060_
            