You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/ai-services/openai/realtime-audio-reference.md
+17-11Lines changed: 17 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1080,7 +1080,7 @@ The server `session.updated` event is returned when a session is updated by the
1080
1080
| Field | Type | Description |
1081
1081
|-------|------|-------------|
1082
1082
| type |[RealtimeClientEventType](#realtimeclienteventtype)| The type of the client event. |
1083
-
| event_id | string | The unique ID of the event. |
1083
+
| event_id | string | The unique ID of the event. The ID can be specified by the client to help identify the event. |
1084
1084
1085
1085
### RealtimeClientEventType
1086
1086
@@ -1148,8 +1148,8 @@ The definition of a function tool as used by the realtime endpoint.
1148
1148
|-------|------|-------------|
1149
1149
| type | string | The type of the tool.<br><br>Allowed values: `function`|
1150
1150
| name | string | The name of the function. |
1151
-
| description | string | The description of the function.|
1152
-
| parameters | object | The parameters of the function. |
1151
+
| description | string | The description of the function, including usage guidelines. For example, "Use this function to get the current time."|
1152
+
| parameters | object | The parameters of the function in the form of a JSON object. |
1153
1153
1154
1154
### RealtimeItemStatus
1155
1155
@@ -1224,6 +1224,8 @@ The definition of a function tool as used by the realtime endpoint.
1224
1224
1225
1225
### RealtimeRequestSession
1226
1226
1227
+
You use the `RealtimeRequestSession` object when you want to update the session configuration via the [session.update](#realtimeclienteventsessionupdate) event.
1228
+
1227
1229
| Field | Type | Description |
1228
1230
|-------|------|-------------|
1229
1231
| modalities | array | The modalities that the session supports.<br><br>Allowed values: `text`, `audio`<br/><br/>For example, `"modalities": ["text", "audio"]` is the default setting that enables both text and audio modalities. To enable only text, set `"modalities": ["text"]`. You can't enable only audio. |
@@ -1234,7 +1236,7 @@ The definition of a function tool as used by the realtime endpoint.
1234
1236
| input_audio_transcription |[RealtimeAudioInputTranscriptionSettings](#realtimeaudioinputtranscriptionsettings)| The settings for audio input transcription.<br><br>This property is nullable. |
1235
1237
| turn_detection |[RealtimeTurnDetection](#realtimeturndetection)| The turn detection settings for the session.<br><br>This property is nullable. |
1236
1238
| tools | array of [RealtimeTool](#realtimetool)| The tools available to the model for the session. |
1237
-
| tool_choice |[RealtimeToolChoice](#realtimetoolchoice)| The tool choice for the session. |
1239
+
| tool_choice |[RealtimeToolChoice](#realtimetoolchoice)| The tool choice for the session.<br><br>Allowed values: `auto`, `none`, and `required`. Otherwise, you can specify the name of the function to use.|
1238
1240
| temperature | number | The sampling temperature for the model. The allowed temperature values are limited to [0.6, 1.2]. Defaults to 0.8. |
1239
1241
| max_response_output_tokens | integer or "inf" | The maximum number of output tokens per assistant response, inclusive of tool calls.<br><br>Specify an integer between 1 and 4096 to limit the output tokens. Otherwise, set the value to "inf" to allow the maximum number of tokens.<br><br>For example, to limit the output tokens to 1000, set `"max_response_output_tokens": 1000`. To allow the maximum number of tokens, set `"max_response_output_tokens": "inf"`.<br><br>Defaults to `"inf"`. |
1240
1242
@@ -1334,6 +1336,10 @@ The response resource.
1334
1336
1335
1337
### RealtimeResponseSession
1336
1338
1339
+
The `RealtimeResponseSession` object represents a session in the Realtime API. It's used in some of the server events, such as:
@@ -1446,21 +1452,21 @@ The base representation of a realtime tool definition.
1446
1452
1447
1453
### RealtimeToolChoice
1448
1454
1449
-
The combined set of available representations for a realtime tool_choice parameter, encompassing both string literal options like 'auto' and structured references to defined tools.
1455
+
The combined set of available representations for a realtime `tool_choice` parameter, encompassing both string literal options like 'auto' and structured references to defined tools.
1450
1456
1451
1457
### RealtimeToolChoiceFunctionObject
1452
1458
1453
-
The representation of a realtime tool_choice selecting a named function tool.
1459
+
The representation of a realtime `tool_choice` selecting a named function tool.
1454
1460
1455
1461
| Field | Type | Description |
1456
1462
|-------|------|-------------|
1457
-
| type | string | The type of the tool_choice.<br><br>Allowed values: `function`|
1463
+
| type | string | The type of the `tool_choice`.<br><br>Allowed values: `function`|
1458
1464
| function | object | The function tool to select.<br><br>See nested properties next.|
1459
1465
| + name | string | The name of the function tool.<br><br>A property of the `function` object. |
1460
1466
1461
1467
### RealtimeToolChoiceLiteral
1462
1468
1463
-
The available set of mode-level, string literal tool_choice options for the realtime endpoint.
1469
+
The available set of mode-level, string literal `tool_choice` options for the realtime endpoint.
1464
1470
1465
1471
**Allowed Values:**
1466
1472
@@ -1470,11 +1476,11 @@ The available set of mode-level, string literal tool_choice options for the real
1470
1476
1471
1477
### RealtimeToolChoiceObject
1472
1478
1473
-
A base representation for a realtime tool_choice selecting a named tool.
1479
+
A base representation for a realtime `tool_choice` selecting a named tool.
1474
1480
1475
1481
| Field | Type | Description |
1476
1482
|-------|------|-------------|
1477
-
| type |[RealtimeToolType](#realtimetooltype)| The type of the tool_choice. |
1483
+
| type |[RealtimeToolType](#realtimetooltype)| The type of the `tool_choice`. |
0 commit comments