fix: remove tcp connector limit

[6matt]

Title

Remove TCP connector limit

Pre-Submission checklist

• I have Added testing in the tests/litellm/ directory, Adding at least 1 test is a hard requirement - see details
• I have added a screenshot of my new test passing locally
• My PR passes all unit tests on make test-unit
• My PR's scope is as isolated as possible, it only solves 1 specific problem

Type

🐛 Bug Fix

Changes

• Remove limit on concurrent TCP connections
  • aiohttp.TCPConnector has a default limit of 100 - this could become a bottleneck in case of high concurrency or long-running requests

[vercel]

@6matt is attempting to deploy a commit to the CLERKIEAI Team on Vercel.

A member of the Team first needs to authorize it.

[ishaan-jaff]

@AlexsanderHamir are there any implications for this perf wise ?

[ishaan-jaff]

I think we can also tune the connector for low latency / high perf while we're at it @AlexsanderHamir

[AlexsanderHamir]

think we can also tune the connector for low latency / high perf while we're at it @AlexsanderHamir

Definitely, it's been an ongoing issue.

[6matt]

@ishaan-jaff are you requesting any specific changes from me, or just blocking this PR?