Skip to content

[FEATURE] Support image standard markdown in agent mode and chat modeΒ #284

@edenreich

Description

@edenreich

Summary

When the agent is requested to read a comment in Github it may contain image syntax, those should be supported in addition to @ sign.

Maybe we should actually deprecate the @ sign for images because in most software it used to mention something and this might collide with other conventions.

A markdown image syntax is like this:

![Screenshot of a comment on a GitHub issue showing an image, added in the Markdown, of an Octocat smiling and raising a tentacle.](https://myoctocat.com/assets/images/base-octocat.svg)

The goal is that if a vision mode on github action is being asked to check a screenshot, it will be able to read and understand the images.

Acceptance Criterias

  • Image markdown syntax is supported
  • agent or chat mode parsing those embedding and attaching them to the prompt properly, the prompt itself is getting replaced with tokens
  • Documentation is adjusted
  • It's tested

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions