Scaled Sets - How to debug Workflow job Queue time?

[jaswanthikolla]

I understand there can be queue time due to Autoscaling's KubeNode spin up and container initialization. But, I am seeing more queue time, and I am currently debugging through kubectl get AutoscalingRunnerSet -n <NAMESPACE> , and seeing delay before the pod is spin up. Also, It's hard debug when there are 100's pod involved for a scaled set.

How do we go about debugging the queue times between the jobs? Github workflow UI is not helpful because "Setup Job" always shows 0s even though it waited minutes for it.