|
58 | 58 | "- **Greater Steerability**: The Realtime model is more steerable, can better follow custom instructions for higher transcription quality, and is not limited by a 1024-token input maximum.\n", |
59 | 59 | "- **Session Context Awareness**: The model has access to the full session context, so, for example, if you mention your name multiple times, it will transcribe it correctly.\n", |
60 | 60 | "\n", |
| 61 | + "\n", |
61 | 62 | "In terms of **trade-offs**:\n", |
62 | | - "- Different cost profile: the realtime model for transcription will take audio in and do text out $32.00\t$0.40. It is also important to note that the whole SESSION CONTEXT is passed in every transcription context, however it will be cached and be priced at $0.40 for cached tokens. The output text tokens is priced at $16.00/M Tokens.\n", |
63 | | - "- gpt-4o-transcription is \t$2.50 text in\t$10.00 text out and $6.00 audio input all per 1M tokens.\n", |
64 | | - "- Other tradfe-offs would be slightly mroe complex to imp-lement compared to simply using the built in transcription option with realtime api with a transcription model.\n", |
| 63 | + "\n", |
| 64 | + "- Realtime Model (for transcription):\n", |
| 65 | + " - Audio Input → Text Output: $32.00 per 1M audio tokens + $16.00 per 1M text tokens out.\n", |
| 66 | + " - Cached Session Context: $0.40 per 1M cached context tokens (typically negligible).\n", |
| 67 | + "\n", |
| 68 | + " - Total Cost (for 1M audio tokens in + 1M text tokens out): ≈ $48.00\n", |
| 69 | + "\n", |
| 70 | + "- GPT-4o Transcription:\n", |
| 71 | + "\n", |
| 72 | + " - Audio Input: $6.00 per 1M audio tokens\n", |
| 73 | + "\n", |
| 74 | + " - Text Input: $2.50 per 1M tokens (capped at 1024 tokens, negligible)\n", |
| 75 | + "\n", |
| 76 | + " - Text Output: $10.00 per 1M tokens\n", |
| 77 | + "\n", |
| 78 | + " - Total Cost (for 1M audio tokens in + 1M text tokens out): ≈ $16.00\n", |
| 79 | + "\n", |
| 80 | + "- Direct Cost Comparison:\n", |
| 81 | + "\n", |
| 82 | + " - Realtime Transcription: ~$48.00\n", |
| 83 | + "\n", |
| 84 | + " - GPT-4o Transcription: ~$16.00\n", |
| 85 | + "\n", |
| 86 | + " - Absolute Difference: $48.00 − $16.00 = $32.00\n", |
| 87 | + "\n", |
| 88 | + " - Cost Ratio: $48.00 / $16.00 = 3×\n", |
| 89 | + "\n", |
| 90 | + " Note: Costs related to cached session context ($0.40 per 1M tokens) and the capped text input tokens for GPT-4o ($2.50 per 1M tokens) are negligible and thus excluded from detailed calculations.\n", |
| 91 | + "\n", |
| 92 | + "- Other Considerations:\n", |
| 93 | + "\n", |
| 94 | + " - Implementing transcription via the realtime model might be slightly more complex compared to using the built-in GPT-4o transcription option through the Realtime API.\n", |
65 | 95 | "\n", |
66 | 96 | "> Note: Ouf-of-band responses using the realtime model can be used for other use cases beyond user turn transcription. Examples include generating structured summaries, triggering background actions, or performing validation tasks without affecting the main conversation.\n", |
67 | 97 | "\n", |
|
0 commit comments