Skip to content

chore: Migrate Notebooks to Generative AI Repository #176

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

chore: Migrate Notebooks to Generative AI Repository #176

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
30 changes: 1 addition & 29 deletions genai-on-vertex-ai/gemini/prompting_recipes/multimodal/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,29 +1 @@
## Multimodal prompting with Gemini 1.5

[Gemini 1.5 Pro and 1.5 Flash](https://cloud.google.com/vertex-ai/generative-ai/docs/learn/models) models supports adding image, audio, video, and PDF files in text or chat prompts to generate a text or code response. Gemini 1.5 Pro supports up to 2 Million input tokens, making it possible to analyze long videos and audio files in a single prompt. This folder has examples to demonstrate multimodal capabilities of Gemini 1.5 and how to effectively write prompts for better results.

### [Multimodal Prompting for Images](multimodal_prompting_image.ipynb)
Demonstrate prompting recipes and strategies for working with Gemini on images:
- Image Understanding
- Using system instruction
- Structuring prompt with images
- Adding few-shot examples the image prompt
- Document understanding
- Math understanding

### [Multimodal Prompting for Audio](multimodal_prompting_audio.ipynb)
Demonstrate prompting recipes and strategies for working with Gemini on audio files:
- Audio Understanding
- Effective prompting
- Key event detection
- Using System instruction
- Generating structured output

### [Multimodal Prompting for Videos](multimodal_prompting_video.ipynb)
Demonstrate prompting recipes and strategies for working with Gemini on video files:
- Video Understanding
- Key event detection
- Using System instruction
- Analyzing videos with step-by-step reasoning
- Generating structured output
- Using context caching for repeated queries
# MOVED TO https://github.com/GoogleCloudPlatform/generative-ai/blob/main/gemini/use-cases/intro_multimodal_use_cases.ipynb
Loading