Network connectivity issues while running docker bake

[oxeye-mher]

Hello everyone,
I hope that someone maybe will be able to help me here.
I try to build my project with docker buildx bake command. It's work very well on a x86 linux computer, but when I try to build in on a M1 Mac, It crash because of network connectivity issues.
Every time I try to build, it crash on some network operation (every time it's another one, it's random..) because of "The connection was closed" error or some SSL related error. For example -

2.158 Downloading https://services.gradle.org/distributions/gradle-6.9-bin.zip
2.655 ............................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................................
3.596 Exception in thread "main" javax.net.ssl.SSLException: Connection reset

I tried to update my mac, I tried to reinstall docker, but nothing helps, it's just crash during the bake.
Does anyone familiar with this issues? what should I try to do ?