-
Notifications
You must be signed in to change notification settings - Fork 135
Description
Bringing again to your attention. This is still not resolved. I just checked Batch API still does not implement this type. Last time you just closed the bug report without even trying to reproduce it (or did you? @Sivasankaran25 seem did not attempt to reproduce it at all. I see @qiaodev did try to reproduce it in other thread, so I do give credit for that, however reproduced wrong API. please try to reproduce the flow I am describing.). Bringing up to your attention again.
How to reproduce?
Again. Try to run Batch Inference WITHOUT "inlined request". You get requests cerialized into a file in Cloud Storage, and then point GenAI to that. The struct that you need to serialize into file in Cloud Storage, still missing and no structs are compatible. We have to define our own as described in ticket.