SpanBuilder should not have `with_end_time`

[cijothomas]

Similar to #2743, SpanBuilder is used to build the Span, and at this point, it should not have end_time.

[scottgerring]

This is used by tokio-tracing, but only in a bench.