Allow nullable logprobs in vLLM serve responses (#5203) #15504
| Job | Run time |
|---|---|
| 12s | |
| 24m 33s | |
| 20m 15s | |
| 16m 37s | |
| 16m 24s | |
| 23m 44s | |
| 24m 50s | |
| 24m 46s | |
| 25m 33s | |
| 24m 10s | |
| 3h 21m 4s |
| Job | Run time |
|---|---|
| 12s | |
| 24m 33s | |
| 20m 15s | |
| 16m 37s | |
| 16m 24s | |
| 23m 44s | |
| 24m 50s | |
| 24m 46s | |
| 25m 33s | |
| 24m 10s | |
| 3h 21m 4s |