Pass headers down instead of using a block

[tenderlove]

Right now we are buffering entire gems in memory when we download them.

• https://github.com/rubygems/rubygems/blob/66c94f65c8a05484f2d12cb0bccd8513da5c65ef/lib/rubygems/request.rb#L208-L216

I would like to open the possibility of streaming assets rather than storing the entire asset in memory. In order to accomplish this, I would like to allow callers to pass a block to indicate that they "want to stream".

Before this commit, we would use the block to set headers on the request object. This commit passes the headers down to construct the request object. Callers know the headers they want to set before calling the method, so it makes sense to pass them in via parameters rather than as a block

[Edouard-chin]

I think we'll need to modify this one too

rubygems/bundler/lib/bundler/fetcher/gem_remote_fetcher.rb

Lines 8 to 11 in 48272fb

	def request(*args)
	super do |req|
	req.delete("User-Agent") if headers["User-Agent"]
	yield req if block_given?