Tests: Delete SymbolGraph/infer-target.swift.

Having a test for this was a nice idea but there just doesn't seem like there's
a way to test it reliably given that cross compilation happens in a wide
variety of CI bot configs.

Resolves rdar://157170133.

Author: tshortli