Normalize runtime timings by the number of tokens #41
Description
The total runtime is not interesting, what we care about is the latency per token generated. We should therefore report this number instead of the total runtime.
{{ message }}
The total runtime is not interesting, what we care about is the latency per token generated. We should therefore report this number instead of the total runtime.