Replies: 1 comment
-
You can see some example of the input in the Notebook here https://github.com/GoogleCloudPlatform/generative-ai/blob/main/gemini/batch-prediction/intro_batch_prediction.ipynb Each line needs to follow the request format listed here: https://cloud.google.com/vertex-ai/generative-ai/docs/model-reference/inference#request |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I am looking for the gemini batch input api schema details.
there are input example given here but i assume this
{"request":{"contents": [{"role": "user", "parts": [{"text": "What is the relation between the following video and image samples?"}, {"fileData": {"fileUri": "gs://cloud-samples-data/generative-ai/video/animals.mp4", "mimeType": "video/mp4"}}, {"fileData": {"fileUri": "gs://cloud-samples-data/generative-ai/image/cricket.jpeg", "mimeType": "image/jpeg"}}]}]}}
but the how do i specifiy more attributes such as request id, or model parameters etc are not there.
i don't see any details in the examples uploaded as well.
Relevant Community questions
https://www.googlecloudcommunity.com/gc/AI-ML/How-do-you-add-quot-parameters-quot-to-a-batch-prediction-job-s/m-p/623569
https://www.googlecloudcommunity.com/gc/AI-ML/How-to-specify-the-Reference-Id-for-each-prompts-requests-in/m-p/851737
Beta Was this translation helpful? Give feedback.
All reactions