Skip to content

Commit f27250d

Browse files
committed
freshness review
1 parent 8ae2084 commit f27250d

File tree

1 file changed

+22
-25
lines changed

1 file changed

+22
-25
lines changed

articles/cdn/cdn-large-file-optimization.md

Lines changed: 22 additions & 25 deletions
Original file line numberDiff line numberDiff line change
@@ -2,53 +2,50 @@
22
title: Large file download optimization with Azure CDN
33
description: Learn how large file downloads can be optimized in Azure Content Delivery Network. This article includes several scenarios.
44
services: cdn
5-
documentationcenter: ''
65
author: duongau
7-
manager: danielgi
8-
editor: ''
9-
10-
ms.assetid:
6+
manager: kumudd
117
ms.service: azure-cdn
128
ms.workload: tbd
139
ms.tgt_pltfrm: na
1410
ms.topic: how-to
15-
ms.date: 05/01/2018
11+
ms.date: 02/27/2023
1612
ms.author: duau
1713
---
14+
1815
# Large file download optimization with Azure CDN
1916

20-
File sizes of content delivered over the internet continue to grow due to enhanced functionality, improved graphics, and rich media content. This growth is driven by many factors: broadband penetration, larger inexpensive storage devices, widespread increase of high-definition video, and internet-connected devices (IoT). A fast and efficient delivery mechanism for large files is critical to ensure a smooth and enjoyable consumer experience.
17+
File sizes of content delivered over the internet continue to grow due to enhanced functionality, improved graphics, and rich media content. This growth gets driven by many factors: broadband penetration, larger inexpensive storage devices, widespread increase of high-definition video, and internet-connected devices (IoT). A fast and efficient delivery mechanism for large files is critical to ensure a smooth and enjoyable consumer experience.
2118

2219
Delivery of large files has several challenges. First, the average time to download a large file can be significant because applications might not download all data sequentially. In some cases, applications might download the last part of a file before the first part. When only a small amount of a file is requested or a user pauses a download, the download can fail. The download also might be delayed until after the content delivery network (CDN) retrieves the entire file from the origin server.
2320

24-
Second, the latency between a user's machine and the file determines the speed at which they can view content. In addition, network congestion and capacity problems also affect throughput. Greater distances between servers and users create additional opportunities for packet loss to occur, which reduces quality. The reduction in quality caused by limited throughput and increased packet loss might increase the wait time for a file download to finish.
21+
Second, the latency between a user's machine and the file determines the speed at which they can view content. In addition, network congestion and capacity problems also affect throughput. Greater distances between servers and users create more opportunities for packet loss to occur, which reduces quality. The reduction in quality caused by limited throughput and increased packet loss might increase the wait time for a file download to finish.
2522

26-
Third, many large files are not delivered in their entirety. Users might cancel a download halfway through or watch only the first few minutes of a long MP4 video. Therefore, software and media delivery companies want to deliver only the portion of a file that's requested. Efficient distribution of the requested portions reduces the egress traffic from the origin server. Efficient distribution also reduces the memory and I/O pressure on the origin server.
23+
Third, many large files aren't delivered in their entirety. Users might cancel a download halfway through or watch only the first few minutes of a long MP4 video. Therefore, software and media delivery companies want to deliver only the portion of a file that's requested. Efficient distribution of the requested portions reduces the egress traffic from the origin server. Efficient distribution also reduces the memory and I/O pressure on the origin server.
2724

2825

2926
## Optimize for delivery of large files with Azure CDN from Microsoft
3027

31-
**Azure CDN Standard from Microsoft** endpoints deliver large files without a cap on file size. Additional features are turned on by default to make delivery of large files faster.
28+
**Azure CDN Standard from Microsoft** endpoints deliver large files without a cap on file size. Extra features are turned on by default to make delivery of large files faster.
3229

3330
### Object chunking
3431

35-
**Azure CDN Standard from Microsoft** uses a technique called object chunking. When a large file is requested, the CDN retrieves smaller pieces of the file from the origin. After the CDN POP server receives a full or byte-range file request, the CDN edge server requests the file from the origin in chunks of 8 MB.
32+
**Azure CDN Standard from Microsoft** uses a technique called object chunking. When a large file is requested, the CDN retrieves smaller pieces of the file from the origin. After the CDN POP server receives a full or byte-ranges file request, the CDN edge server requests the file from the origin in chunks of 8 MB.
3633

37-
After the chunk arrives at the CDN edge, it's cached and immediately served to the user. The CDN then prefetches the next chunk in parallel. This prefetch ensures that the content stays one chunk ahead of the user, which reduces latency. This process continues until the entire file is downloaded (if requested), all byte ranges are available (if requested), or the client terminates the connection.
34+
After the chunk arrives at the CDN edge, it's cached and immediately served to the user. The CDN then prefetches the next chunk in parallel. This prefetch ensures that the content stays one chunk ahead of the user, which reduces latency. This process continues until the entire file gets downloaded (if requested), all byte ranges are available (if requested), or the client terminates the connection.
3835

3936
For more information on the byte-range request, see [RFC 7233](https://tools.ietf.org/html/rfc7233).
4037

41-
The CDN caches any chunks as they're received. The entire file doesn't need to be cached on the CDN cache. Subsequent requests for the file or byte ranges are served from the CDN cache. If not all the chunks are cached on the CDN, prefetch is used to request chunks from the origin. This optimization relies on the ability of the origin server to support byte-range requests; if the origin server doesn't support byte-range requests, requests to download data greater than 8mb size will fail.
38+
The CDN caches any chunks as they're received. The entire file doesn't need to be cached on the CDN cache. Subsequent requests for the file or byte ranges are served from the CDN cache. If not all the chunks are cached on the CDN, prefetch is used to request chunks from the origin. This optimization relies on the ability of the origin server to support byte-range requests. If the origin server doesn't support byte-range requests, requests to download data greater than 8-MB size fails.
4239

4340
### Conditions for large file optimization
4441
There are no limits on maximum file size.
4542

4643
### Chunked Transfer Encoding Support
47-
Microsoft CDN supports transfer encoding response but only up to a maximum of 8MB content size. For chunked tranfer encoded response that greater then 8MB, Microsoft CDN will only cache and serve the first 8MB of content.
44+
Microsoft CDN supports transfer encoding response but only up to a maximum of 8-MB content size. For chunked transfer encoded response that greater than 8 MB, Microsoft CDN only cache and serve the first 8 MB of content.
4845

4946
## Optimize for delivery of large files with Azure CDN from Verizon
5047

51-
**Azure CDN Standard from Verizon** and **Azure CDN Premium from Verizon** endpoints deliver large files without a cap on file size. Additional features are turned on by default to make delivery of large files faster.
48+
**Azure CDN Standard from Verizon** and **Azure CDN Premium from Verizon** endpoints deliver large files without a cap on file size. More features are turned on by default to make delivery of large files faster.
5249

5350
### Complete cache fill
5451

@@ -60,7 +57,7 @@ The default behavior can be disabled through the rules engine in **Azure CDN Pre
6057

6158
### Peer cache fill hot-filing
6259

63-
The default peer cache fill hot-filing feature uses a sophisticated proprietary algorithm. It uses additional edge caching servers based on bandwidth and aggregate requests metrics to fulfill client requests for large, highly popular objects. This feature prevents a situation in which large numbers of extra requests are sent to a user's origin server.
60+
The default peer cache fills hot-filing feature uses a sophisticated proprietary algorithm. It uses extra edge caching servers based on bandwidth and aggregate requests metrics to fulfill client requests for large, highly popular objects. This feature prevents a situation in which large numbers of extra requests are sent to a user's origin server.
6461

6562
### Conditions for large file optimization
6663

@@ -77,7 +74,7 @@ Large file optimization is effective when certain conditions are satisfied. Cond
7774

7875
### Configure an Akamai CDN endpoint to optimize delivery of large files
7976

80-
You can configure your **Azure CDN Standard from Akamai** endpoint to optimize delivery for large files via the Azure portal. You can also use the REST APIs or any of the client SDKs to do this. The following steps show the process via the Azure portal for an **Azure CDN Standard from Akamai** profile:
77+
You can configure your **Azure CDN Standard from Akamai** endpoint to optimize delivery for large files via the Azure portal. You can also use the REST APIs or any of the client SDKs to complete this task. The following steps show the process via the Azure portal for an **Azure CDN Standard from Akamai** profile:
8178

8279
1. To add a new endpoint, on an Akamai **CDN profile** page, select **Endpoint**.
8380

@@ -92,9 +89,9 @@ After you create the CDN endpoint, it applies the large file optimizations for a
9289

9390
### Object chunking
9491

95-
Large file optimization with **Azure CDN Standard from Akamai** uses a technique called object chunking. When a large file is requested, the CDN retrieves smaller pieces of the file from the origin. After the CDN POP server receives a full or byte-range file request, it checks whether the file type is supported for this optimization. It also checks whether the file type meets the file size requirements. If the file size is greater than 10 MB, the CDN edge server requests the file from the origin in chunks of 2 MB.
92+
Large file optimization with **Azure CDN Standard from Akamai** uses a technique called object chunking. When a large file is requested, the CDN retrieves smaller pieces of the file from the origin. After the CDN POP server receives a full or byte-rangess file request, it checks whether the file type is supported for this optimization. It also checks whether the file type meets the file size requirements. If the file size is greater than 10 MB, the CDN edge server requests the file from the origin in chunks of 2 MB.
9693

97-
After the chunk arrives at the CDN edge, it's cached and immediately served to the user. The CDN then prefetches the next chunk in parallel. This prefetch ensures that the content stays one chunk ahead of the user, which reduces latency. This process continues until the entire file is downloaded (if requested), all byte ranges are available (if requested), or the client terminates the connection.
94+
After the chunk arrives at the CDN edge, it's cached and immediately served to the user. The CDN then prefetches the next chunk in parallel. This prefetch ensures that the content stays one chunk ahead of the user, which reduces latency. This process continues until the entire file gets downloaded (if requested), all byte ranges are available (if requested), or the client terminates the connection.
9895

9996
For more information on the byte-range request, see [RFC 7233](https://tools.ietf.org/html/rfc7233).
10097

@@ -105,14 +102,14 @@ Large file optimization uses different default caching-expiration times from gen
105102

106103
| Caching | General web | Large file optimization
107104
--- | --- | ---
108-
Caching: Positive <br> HTTP 200, 203, 300, <br> 301, 302, and 410 | 7 days |1 day
105+
Caching: Positive <br> HTTP 200, 203, 300, <br> 301, 302, and 410 | Seven days |One day
109106
Caching: Negative <br> HTTP 204, 305, 404, <br> and 405 | None | 1 second
110107

111108
### Deal with origin failure
112109

113110
The origin read-timeout length increases from two seconds for general web delivery to two minutes for the large file optimization type. This increase accounts for the larger file sizes to avoid a premature timeout connection.
114111

115-
When a connection times out, the CDN retries a number of times before it sends a "504 - Gateway Timeout" error to the client.
112+
When a connection times out, the CDN retries many times before it sends a "504 - Gateway Timeout" error to the client.
116113

117114
### Conditions for large file optimization
118115

@@ -125,15 +122,15 @@ Minimum file size | 10 MB
125122
Maximum file size | 150 GB
126123
Origin server characteristics | Must support byte-range requests
127124

128-
## Additional considerations
125+
## Other considerations
129126

130-
Consider the following additional aspects for this optimization type:
127+
Consider the following aspects for this optimization type:
131128

132-
- The chunking process generates additional requests to the origin server. However, the overall volume of data delivered from the origin is much smaller. Chunking results in better caching characteristics at the CDN.
129+
- The chunking process generates more requests to the origin server. However, the overall volume of data delivered from the origin is smaller. Chunking results in better caching characteristics at the CDN.
133130

134131
- Memory and I/O pressure are reduced at the origin because smaller pieces of the file are delivered.
135132

136-
- For chunks cached at the CDN, there are no additional requests to the origin until the content expires or it's evicted from the cache.
133+
- For chunks cached at the CDN, there are no other requests to the origin until the content expires or it's evicted from the cache.
137134

138135
- Users can make range requests to the CDN, which are treated like any normal file. Optimization applies only if it's a valid file type and the byte range is between 10 MB and 150 GB. If the average file size requested is smaller than 10 MB, use general web delivery instead.
139136

0 commit comments

Comments
 (0)