[Bug]: PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True causes crash during startup if enable_attention_dp:false

[Bug]: PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True causes crash during startup if enable_attention_dp:false #1661