Skip to content

Commit 064b811

Browse files
authored
Merge pull request #100437 from tamram/tamram-0108
fixing scalability links
2 parents 6f6301d + af91560 commit 064b811

File tree

3 files changed

+4
-4
lines changed

3 files changed

+4
-4
lines changed

articles/hdinsight/hdinsight-key-scenarios-to-monitor.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -67,7 +67,7 @@ In the Resource Manager UI, select **Scheduler** from the left-hand menu. You se
6767

6868
## Storage throttling
6969

70-
A cluster's performance bottleneck can happen at the storage level. This type of bottleneck is most often because of *blocking* input/output (IO) operations, which happen when your running tasks send more IO than the storage service can handle. This blocking creates a queue of IO requests waiting to be processed until after current IOs are processed. The blocks are because of *storage throttling*, which isn't a physical limit, but rather a limit imposed by the storage service by a service level agreement (SLA). This limit ensures that no single client or tenant can monopolize the service. The SLA limits the number of IOs per second (IOPS) for Azure Storage - for details, see [Azure Storage Scalability and Performance Targets](https://docs.microsoft.com/azure/storage/storage-scalability-targets).
70+
A cluster's performance bottleneck can happen at the storage level. This type of bottleneck is most often because of *blocking* input/output (IO) operations, which happen when your running tasks send more IO than the storage service can handle. This blocking creates a queue of IO requests waiting to be processed until after current IOs are processed. The blocks are because of *storage throttling*, which isn't a physical limit, but rather a limit imposed by the storage service by a service level agreement (SLA). This limit ensures that no single client or tenant can monopolize the service. The SLA limits the number of IOs per second (IOPS) for Azure Storage - for details, see [Scalability and performance targets for standard storage accounts](../storage/common/scalability-targets-standard-account.md).
7171

7272
If you're using Azure Storage, for information on monitoring storage-related issues, including throttling, see [Monitor, diagnose, and troubleshoot Microsoft Azure Storage](https://docs.microsoft.com/azure/storage/storage-monitoring-diagnosing-troubleshooting).
7373

articles/hdinsight/spark/apache-spark-troubleshoot-event-log-requestbodytoolarge.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,7 @@ The error: `NativeAzureFileSystem ... RequestBodyTooLarge` appears in the driver
2121

2222
Your Spark event log file is probably hitting the file length limit for WASB.
2323

24-
In Spark 2.3, each Spark app generates one Spark event log file. The Spark event log file for a Spark streaming app continues to grow while the app is running. Today a file on WASB has a 50000 block limit, and the default block size is 4 MB. So in default configuration the max file size is 195 GB. However, Azure storage has increased the max block size to 100 MB, which effectively brought the single file limit to 4.75 TB. For more information, see [Azure Storage Scalability and Performance Targets](https://docs.microsoft.com/azure/storage/common/storage-scalability-targets).
24+
In Spark 2.3, each Spark app generates one Spark event log file. The Spark event log file for a Spark streaming app continues to grow while the app is running. Today a file on WASB has a 50000 block limit, and the default block size is 4 MB. So in default configuration the max file size is 195 GB. However, Azure Storage has increased the max block size to 100 MB, which effectively brought the single file limit to 4.75 TB. For more information, see [Scalability and performance targets for Blob storage](../../storage/blobs/scalability-targets.md).
2525

2626
## Resolution
2727

articles/virtual-machines/troubleshooting/troubleshoot-performance-virtual-machine-linux-windows.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -209,11 +209,11 @@ With new disk offerings under Standard storage, the IOPS and Throughput limits c
209209

210210
#### References
211211

212-
* [Scalability targets for virtual machine disks](https://azure.microsoft.com/documentation/articles/storage-scalability-targets/#scalability-targets-for-virtual-machine-disks)
212+
* [Scalability and performance targets for premium page blob storage accounts](../../storage/blobs/scalability-targets-premium-page-blobs.md)
213213

214214
The bandwidth of the storage account is measured by the Storage Account Metrics: TotalIngress and TotalEgress. You have different thresholds for bandwidth depending on type of redundancy and regions.
215215

216-
* [Scalability targets for blobs, queues, tables, and files](https://azure.microsoft.com/documentation/articles/storage-scalability-targets/#scalability-targets-for-blobs-queues-tables-and-files)
216+
* [Scalability and performance targets for standard storage accounts](../../storage/common/scalability-targets-standard-account.md)
217217

218218
Check the TotalIngress and TotalEgress against the Ingress and Egress limits for the storage account redundancy type and region.
219219

0 commit comments

Comments
 (0)