Feature request: Retries and rate-limits on egress (outbound connections)

[alex-remedios-aisi]

a great feature addition to the k8s provider would be egress throttling/retries IMO
this would enable us to scalably run evals that use text/multimodal browsing without bot detection skewing results

(slack thread)

[tcatling]

some of this (retries, backoff etc) definitely seems like a responsibility of the client, but we could probably impose some bandwidth management via cilium. There's an interesting discussion of this here

[alex-remedios-aisi]

(i'd downweight this now because web browsing is almost never scalable/secure enough to use as a long-term tooling approach for me)