Skip to content

Commit 0ce92ba

Browse files
authored
Merge pull request #298563 from craigshoemaker/aca/cold-start-updates
[Container Apps] Update: Cold start
2 parents a30fbad + 531cfe8 commit 0ce92ba

File tree

3 files changed

+10
-24
lines changed

3 files changed

+10
-24
lines changed

articles/container-apps/TOC.yml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -78,8 +78,6 @@
7878
href: https://youtu.be/OxmVds31qL8
7979
- name: Communicate between multiple apps
8080
href: connect-apps.md
81-
- name: Reduce cold-start times
82-
href: cold-start.md
8381
- name: Develop & deploy
8482
items:
8583
- name: Deployment options
@@ -225,6 +223,8 @@
225223
displayName: Scale rules and performance overview
226224
- name: Scale a container app
227225
href: tutorial-scaling.md
226+
- name: Reduce cold-start times
227+
href: cold-start.md
228228
- name: Domains & certificates
229229
items:
230230
- name: Overview

articles/container-apps/cold-start.md

Lines changed: 4 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ services: container-apps
55
author: craigshoemaker
66
ms.service: azure-container-apps
77
ms.topic: conceptual
8-
ms.date: 04/15/2025
8+
ms.date: 05/06/2025
99
ms.author: cshoe
1010
---
1111

@@ -27,12 +27,11 @@ Often images transition training to inference usage with only minimal tweaks. Ma
2727

2828
Use container registries close to your Container Apps environment. Usually this means you want to use an Azure Container Registry deployed in the same region as your environment, or a premium registry that features global distribution.
2929

30-
## Use artifact streaming
30+
## Manage large downloads
3131

32-
Azure Container Registry [offers image streaming](/azure/container-apps/serverless-gpu-nim#enable-artifact-streaming-recommended-but-optional) which can speed up image startup by up to 15%.
32+
Use [storage mounts to hold critical data close to your container app](storage-mounts.md), especially when the file sizes are large. For instance, if your app requires a large language model, you can pre-download the model to your storage account. By reading large files from a storage account, you avoid the latency of pulling files across the internet.
3333

34-
> [!NOTE]
35-
> Artifact streaming is only supported with [serverless GPUs](./gpu-serverless-overview.md).
34+
If you are creating a storage mount for AI workloads, make sure you use the most appropriate [mount options](/troubleshoot/azure/azure-kubernetes/storage/mountoptions-settings-azure-files) for your needs.
3635

3736
## Implement custom liveness health probe or start listening early
3837

articles/container-apps/gpu-serverless-overview.md

Lines changed: 4 additions & 17 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ ms.service: azure-container-apps
77
ms.custom:
88
- ignite-2024
99
ms.topic: how-to
10-
ms.date: 03/17/2025
10+
ms.date: 04/24/2025
1111
ms.author: cshoe
1212
---
1313

@@ -93,24 +93,11 @@ Serverless GPUs are run on consumption GPU workload profiles. You manage a consu
9393

9494
## Improve GPU cold start
9595

96-
You can improve cold start on your GPU-enabled containers by enabling artifact streaming on your Azure Container Registry. For more information, see [enable artifact streaming](/azure/container-registry/container-registry-artifact-streaming?pivots=development-environment-azure-cli).
96+
You can significantly improve cold start times by enabling artifact streaming and locating large files, like large language models, in a storage mount.
9797

98-
> [!NOTE]
99-
> To use artifact streaming, your container images must be hosted in a premium Azure Container Registry.
100-
101-
Use the following steps to enable image streaming:
102-
103-
1. Open your Azure Container Registry in the Azure portal.
104-
105-
1. Search for **Repositories**, and select **Repositories**.
106-
107-
1. Select your repository name.
108-
109-
1. From the *Repository* window, select **Start artifact streaming**.
110-
111-
1. Select the image tag that you want to stream.
98+
- [Artifact streaming](/azure/container-registry/container-registry-artifact-streaming): Azure Container Registry offers image streaming which can significantly speed up image startup times. To use artifact streaming, your container images must be hosted in a premium Azure Container Registry.
11299

113-
1. In the window that pops up, select **Create streaming artifact**.
100+
- [Storage mounts](cold-start.md#manage-large-downloads): Reduce the effects of network latency by storing large files in an Azure storage account associated with your container app.
114101

115102
## Submit feedback
116103

0 commit comments

Comments
 (0)