Merge pull request #265574 from mrbullwinkle/mrb_02_07_2024_latency

[Azure OpenAI] Markdown syntax and typo fix

Author: prmerger-automator[bot]

articles/ai-services/openai/how-to/latency.md

@@ -5,7 +5,7 @@ description: Learn about performance and latency with Azure OpenAI
 manager: nitinme
 ms.service: azure-ai-openai
 ms.topic: how-to
-ms.date: 11/21/2023
+ms.date: 02/07/2024
 author: mrbullwinkle 
 ms.author: mbullwin
 recommendations: false
@@ -58,17 +58,17 @@ Latency varies based on what model you're using. For an identical request, expec
 
 When you send a completion request to the Azure OpenAI endpoint, your input text is converted to tokens that are then sent to your deployed model. The model receives the input tokens and then begins generating a response. It's an iterative sequential process, one token at a time. Another way to think of it is like a for loop with `n tokens = n iterations`. For most models, generating the response is the slowest step in the process.  
 
-At the time of the request, the requested generation size (max_tokens parameter) is used as an initial estimate of the generation size. The compute-time for generating the full size is reserved the model as the request is processed. Once the generation is completed, the remaining quota is released. Ways to reduce the number of tokens:
-o	Set the `max_token` parameter on each call as small as possible.
-o	Include stop sequences to prevent generating extra content. 
-o	Generate fewer responses: The best_of & n parameters can greatly increase latency because they  generate multiple outputs. For the fastest response, either don't specify these values or set them to 1.
+At the time of the request, the requested generation size (max_tokens parameter) is used as an initial estimate of the generation size. The compute-time for generating the full size is reserved by the model as the request is processed. Once the generation is completed, the remaining quota is released. Ways to reduce the number of tokens:
+- Set the `max_token` parameter on each call as small as possible.
+- Include stop sequences to prevent generating extra content.
+- Generate fewer responses: The best_of & n parameters can greatly increase latency because they generate multiple outputs. For the fastest response, either don't specify these values or set them to 1.
 
 In summary, reducing the number of tokens generated per request reduces the latency of each request.
 
 ### Streaming
 Setting `stream: true` in a request makes the service return tokens as soon as they're available, instead of waiting for the full sequence of tokens to be generated. It doesn't change the time to get all the tokens, but it reduces the time for first response. This approach provides a better user experience since end-users can read the response as it is generated. 
 
-Streaming is also valuable with large calls that take a long time to process. Many clients and intermediary layers have timeouts on individual calls. Long generation calls might be canceled due to client-side time outs. By streaming the data back, you can ensure incremental data is received. 
+Streaming is also valuable with large calls that take a long time to process. Many clients and intermediary layers have timeouts on individual calls. Long generation calls might be canceled due to client-side time outs. By streaming the data back, you can ensure incremental data is received.