Default deployment variables assumes multimodal embeddings use

[markti]

I've set this up successfully previously. but using all the defaults.

basically ran azd up.

this time the deployment is successful BUT getting runtime errors when chatting in the app.

App insights is saying there are failed transactions here:

seems like this is failing. GET /.auth/me

was authentication added as default or something?

It also seems I am getting 500 on /ask

Traceback (most recent call last):
  File "/app/app.py", line 190, in ask
    r = await approach.run(
        ^^^^^^^^^^^^^^^^^^^
  File "/app/approaches/retrievethenread.py", line 99, in run
    extra_info = await self.run_search_approach(messages, overrides, auth_claims)
                 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/app/approaches/retrievethenread.py", line 171, in run_search_approach
    vectors.append(await self.compute_multimodal_embedding(q))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/app/approaches/approach.py", line 536, in compute_multimodal_embedding
    raise ValueError("Approach is missing an image embeddings client for multimodal queries")
ValueError: Approach is missing an image embeddings client for multimodal queries

[pamelafox]

Looking into this now:

The .auth/me is an expected 404, the app always tries to check that to see if app service built-in auth is enabled.

The actual error is the one in the traceback, which should only happen if USE_MULTIMODAL is true, but you said you're using the defaults, so let me see if I bungled up the defaults somewhere.

Thanks for reporting!

[pamelafox]

I'm sending the fix- the frontend has the wrong defaults in Chat.tsx and Ask.tsx. Changing these lines:

const [searchImageEmbeddings, setSearchImageEmbeddings] = useState<boolean>(false);
const [sendImageSources, setSendImageSources] = useState<boolean>(false);

[pamelafox]

I've merged the fix, so you can pull from main or apply the suggested changes. The primary change you need is to Chat.tsx and Ask.tsx, everything else was additional guard logic. Thanks for reporting!