Is it possible to use binary image data with a handlebars template?

[jmservera]

I'm trying to do something like this:

var getDescription= kernel.CreateFunctionFromPrompt(
    """
    <message role="system>You are an AI assistant that based on a picture or its description you transform it to a funny title
    in English, French and Spanish.
    The output should be a json file with "en", "fr" and "es" as keys for the translations.
    Here is the output schema:
        {
         "en":"English description",
         "fr": "French translation",
         "es": "Spanish translation"
        }
    </message>
    <message role="user">
    {{#if image}}
    <image>
    {{image}}
    </image>
    {{/if}}
    <text>
    {{#if caption}}
    Here are the captions for the picture: {{caption}}
    {{/if}}
    {{#if people}}
    Here's the people that appear in the picture: {{ people }}
    {{/if}}
    Please provide a funny sentence for this.
    </text>
    </message>
    """, templateFormat: "handlebars",promptTemplateFactory: new HandlebarsPromptTemplateFactory());

but the <image> tag seems to only take uri as valid value. I've tried with ImageContent's DataUri but then I get a token limit exception:

ImageContent image=new(new ReadOnlyMemory<byte>(bytes), "image/jpeg");
    parameters.Add("image",image.DataUri);

Thanks,
Juanma

[ghost]

+1

[sphenry]

@jmservera What model are you using?

@markwallace-microsoft FYI

[markwallace-microsoft]

I am cleaning up old unanswered discussions