Skip to content

Commit 34fdb50

Browse files
hubwriterelliebennettsunbrye
authored
Copilot image capabilities on GitHub.com [Public Preview] (#54934)
Co-authored-by: Ellie Bennett <[email protected]> Co-authored-by: Sunbrye Ly <[email protected]>
1 parent 6bca74d commit 34fdb50

File tree

6 files changed

+61
-11
lines changed

6 files changed

+61
-11
lines changed

content/copilot/managing-copilot/managing-github-copilot-in-your-organization/managing-policies-for-copilot-in-your-organization.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@ Organization owners can set policies to govern how {% data variables.product.pro
2929
* {% data variables.product.prodname_copilot_short %} in {% data variables.product.prodname_dotcom_the_website %}
3030
* {% data variables.product.prodname_copilot_chat_short %} in the IDE
3131
* Editor preview features, such as:
32-
* Vision (available in {% data variables.product.prodname_vscode_shortname %} and {% data variables.product.prodname_vs %})
32+
* Using images in {% data variables.product.prodname_copilot_chat_short %} (available in {% data variables.product.prodname_vscode_shortname %} and {% data variables.product.prodname_vs %})
3333
* {% data variables.copilot.next_edit_suggestions_caps %} (available in {% data variables.product.prodname_vscode_shortname %})
3434
* GPT-4o {% data variables.product.prodname_copilot_short %} code completion (available in {% data variables.product.prodname_vscode_shortname %} and JetBrains IDEs)
3535
* {% data variables.product.prodname_copilot_short %} Edits agent mode (available in {% data variables.product.prodname_vscode_shortname %})

content/copilot/using-github-copilot/copilot-chat/asking-github-copilot-questions-in-github.md

Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -325,6 +325,28 @@ You can ask {% data variables.product.prodname_copilot_short %} to explain the c
325325
326326
{% data reusables.copilot.stop-response-generation %}
327327

328+
## Using images in {% data variables.product.prodname_copilot_chat_short %}
329+
330+
> [!NOTE]
331+
> * Attaching images to chat prompts is currently in {% data variables.release-phases.public_preview %} and is subject to change.
332+
> * You can only attach an image in the immersive view of {% data variables.product.prodname_copilot_chat_short %} ([https://github.com/copilot](https://github.com/copilot)), not in the chat panel.
333+
334+
You can attach an image to {% data variables.product.prodname_copilot_short %} and then ask about the image. For example, you can attach:
335+
336+
{% data reusables.copilot.image-questions-and-file-types %}
337+
338+
### Attaching an image to your chat prompt
339+
340+
1. Go to the immersive view of {% data variables.product.prodname_copilot_chat_short %} ([https://github.com/copilot](https://github.com/copilot)).
341+
1. Make sure you have **GPT-4o** selected in the AI model picker at the top of the page.
342+
1. Do one of the following:
343+
344+
* Copy an image and paste it into the prompt box at the bottom of the page.
345+
* Click {% octicon "paperclip" aria-label="Add attachment" %} in the prompt box, then click **Image**. Browse to the image file you want to attach, select it and click **Open**.
346+
* Drag and drop an image file from your operating system's file explorer into the prompt box.
347+
348+
{% data reusables.copilot.type-prompt-for-image %}
349+
328350
## Accessing {% data variables.product.prodname_copilot_chat_short %} from the search bar
329351

330352
You can ask {% data variables.product.prodname_copilot_short %} a question about an entire repository by typing your question in the main search box of the repository.

content/copilot/using-github-copilot/copilot-chat/asking-github-copilot-questions-in-your-ide.md

Lines changed: 23 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -131,15 +131,21 @@ For more detailed instructions, see [{% data variables.product.prodname_copilot_
131131

132132
For more information, see [{% data variables.product.prodname_copilot_edits_short %}](https://aka.ms/vscode-copilot-agent) in the {% data variables.product.prodname_vscode %} documentation.
133133

134-
## Vision
134+
## Using images in {% data variables.product.prodname_copilot_chat_short %}
135135

136-
> [!NOTE] Vision is currently in {% data variables.release-phases.public_preview %} and is subject to change.
136+
{% data reusables.copilot.using-images-in-chat %}
137137

138-
Vision requires that you use the GPT-4o model and upload one of the following file types: JPEG (`.jpg`, `.jpeg`), PNG (`.png`), GIF (`.gif`), or WEBP (`.webp`).
138+
### Attaching images to your chat prompt
139139

140-
You can attach images to your chat prompts to help {% data variables.product.prodname_copilot_short %} understand your question. For example, you can attach a screenshot of a code snippet to ask {% data variables.product.prodname_copilot_short %} to explain the code, or share mockups of new designs to ask {% data variables.product.prodname_copilot_short %} to generate code.
140+
1. Make sure GPT-4o is selected in the model picker at the bottom right of the chat view.
141141

142-
You can drag and drop images into the chat window, or attach them through the {% data variables.product.prodname_vscode_shortname %} UI.
142+
1. Do one of the following:
143+
144+
* Copy an image and paste it into the chat view.
145+
* Drag and drop one or more image file from your operating system's file explorer—or from the Explorer in {% data variables.product.prodname_vscode_shortname %}—into the chat view.
146+
* Right-click an image file in the {% data variables.product.prodname_vscode_shortname %} Explorer and click **{% data variables.product.prodname_copilot_short %}** then **Add File to Chat**.
147+
148+
{% data reusables.copilot.type-prompt-for-image %}
143149

144150
## Sharing feedback
145151

@@ -245,15 +251,22 @@ In addition to submitting prompts through the chat window, you can submit prompt
245251

246252
See [Ask questions in the inline chat view](https://learn.microsoft.com/visualstudio/ide/visual-studio-github-copilot-chat#ask-questions-in-the-inline-chat-view) in the {% data variables.product.prodname_vs %} documentation for more details.
247253

248-
## Vision
254+
## Using images in {% data variables.product.prodname_copilot_chat_short %}
255+
256+
{% data reusables.copilot.using-images-in-chat %}
257+
258+
### Attaching images to your chat prompt
259+
260+
1. Make sure GPT-4o is selected in the model picker at the bottom right of the chat view.
249261

250-
> [!NOTE] Vision is currently in {% data variables.release-phases.public_preview %} and is subject to change.
262+
1. Do one of the following:
251263

252-
Vision requires that you use the GPT-4o model and upload one of the following file types: JPEG (`.jpg`, `.jpeg`), PNG (`.png`), GIF (`.gif`), or WEBP (`.webp`).
264+
* Copy an image and paste it into the chat view.
265+
* Click the paperclip icon at the bottom right of the chat view, click **Upload Image**, browse to the image file you want to attach, select it and click **Open**.
253266

254-
You can attach images to your chat prompts to help {% data variables.product.prodname_copilot_short %} understand your question. For example, you can attach a screenshot of a code snippet to ask {% data variables.product.prodname_copilot_short %} to explain the code, or share mockups of new designs to ask {% data variables.product.prodname_copilot_short %} to generate code.
267+
You can add multiple images if required.
255268

256-
You can drag and drop images into the chat window, or attach them through the {% data variables.product.prodname_vs %} UI.
269+
1. Type your prompt into the chat view to accompany the image. For example, `explain this image`, or `describe each of these images in detail`.
257270

258271
## Sharing feedback
259272

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
* A screenshot of a code snippet and ask {% data variables.product.prodname_copilot_short %} to explain the code.
2+
* A mockup of the user interface for an application and ask {% data variables.product.prodname_copilot_short %} to generate the code.
3+
* A flowchart and ask {% data variables.product.prodname_copilot_short %} to describe the processes shown in the image.
4+
* A screenshot of a web page and ask {% data variables.product.prodname_copilot_short %} to generate HTML for a similar page.
5+
6+
> [!NOTE]
7+
> The following types of image file are supported: JPEG (`.jpg`, `.jpeg`), PNG (`.png`), GIF (`.gif`), or WEBP (`.webp`).
Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
1+
1. Type your prompt into the chat view to accompany the image. For example, `explain this diagram`, `describe each of these images in detail`, `what does this error message mean`.
Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
> [!NOTE]
2+
> * Attaching images to chat prompts is currently in {% data variables.release-phases.public_preview %} and is subject to change.
3+
> * {% data reusables.copilot.editor-preview-settings %}
4+
5+
You can attach images to your chat prompts and then ask {% data variables.product.prodname_copilot_short %} about the images. For example, you can attach:
6+
7+
{% data reusables.copilot.image-questions-and-file-types %}

0 commit comments

Comments
 (0)