Merge pull request #245669 from mrbullwinkle/mrb_07_20_2023_ada_v2_array_size

[Azure AI] [Azure OpenAI] update embedding array info

Author: prmerger-automator[bot]

articles/ai-services/openai/faq.yml

@@ -48,7 +48,7 @@ sections:
       - question: |
           I am trying to use embeddings and received the error "InvalidRequestError: Too many inputs. The max number of inputs is 1." How do I fix this?
         answer: | 
-          This error typically occurs when you try to send a batch of text to embed in a single API request as an array. Currently Azure OpenAI does not support batching with embedding requests. Embeddings API calls should consist of a single string input per request. The string can be up to 8191 tokens in length when using the text-embedding-ada-002 (Version 2) model.
+          This error typically occurs when you try to send a batch of text to embed in a single API request as an array. Currently Azure OpenAI only supports arrays of embeddings with multiple inputs for the `text-embedding-ada-002` Version 2 model. This model version supports an array consisting of up to 16 inputs per API request. The array can be up to 8191 tokens in length when using the text-embedding-ada-002 (Version 2) model.
       - question: |
           Where can I read about better ways to use Azure OpenAI to get the responses I want from the service?
         answer: | 

articles/ai-services/openai/how-to/switching-endpoints.md

@@ -8,7 +8,7 @@ ms.service: cognitive-services
 ms.subservice: openai
 ms.custom: devx-track-python
 ms.topic: how-to
-ms.date: 05/24/2023
+ms.date: 07/20/2023
 manager: nitinme
 ---
 
@@ -161,9 +161,9 @@ embedding = openai.Embedding.create(
 </tr>
 </table>
 
-## Azure OpenAI embeddings doesn't support multiple inputs
+## Azure OpenAI embeddings multiple input support
 
-Many examples show passing multiple inputs into the embeddings API. For Azure OpenAI, currently we must pass a single text input per call.
+OpenAI currently allows a larger number of array inputs with text-embedding-ada-002. Azure OpenAI currently supports input arrays up to 16 for text-embedding-ada-002 Version 2. Both require the max input token limit per API request to remain under 8191 for this model.
 
 <table>
 <tr>
@@ -173,7 +173,7 @@ Many examples show passing multiple inputs into the embeddings API. For Azure Op
 <td>
 
 ```python
-inputs = ["A", "B", "C"]
+inputs = ["A", "B", "C"] 
 
 embedding = openai.Embedding.create(
   input=inputs,
@@ -187,14 +187,13 @@ embedding = openai.Embedding.create(
 <td>
 
 ```python
-inputs = ["A", "B", "C"]
-
-for text in inputs:
-    embedding = openai.Embedding.create(
-        input=text,
-        deployment_id="text-embedding-ada-002"
-        #engine="text-embedding-ada-002"
-    )
+inputs = ["A", "B", "C"] #max array size=16
+
+embedding = openai.Embedding.create(
+  input=inputs,
+  deployment_id="text-embedding-ada-002"
+  #engine="text-embedding-ada-002"
+)
 ```
 
 </td>

articles/ai-services/openai/whats-new.md

@@ -8,7 +8,7 @@ ms.author: mbullwin
 ms.service: cognitive-services
 ms.subservice: openai
 ms.topic: whats-new
-ms.date: 06/12/2023
+ms.date: 07/20/2023
 recommendations: false
 keywords:  
 ---
@@ -17,10 +17,14 @@ keywords:
 
 ## July 2023
 
-### Support for function calling 
+### Support for function calling
 
 - [Azure OpenAI now supports function calling](./how-to/function-calling.md) to enable you to work with functions in the chat completions API.
 
+### Embedding input array increase
+
+- Azure OpenAI now [supports arrays with up to 16 inputs](./how-to/switching-endpoints.md#azure-openai-embeddings-multiple-input-support) per API request with text-embedding-ada-002 Version 2.
+
 ## June 2023
 
 ### Use Azure OpenAI on your own data (preview)