Skip to content

Commit 20c8919

Browse files
Merge pull request #251775 from v-akarnase/patch-30
Update troubleshoot-debug-wasb.md
2 parents 5172994 + 45a6e73 commit 20c8919

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

articles/hdinsight/spark/troubleshoot-debug-wasb.md

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -3,14 +3,14 @@ title: Debug WASB file operations in Azure HDInsight
33
description: Describes troubleshooting steps and possible resolutions for issues when interacting with Azure HDInsight clusters.
44
ms.service: hdinsight
55
ms.topic: troubleshooting
6-
ms.date: 07/19/2022
6+
ms.date: 09/19/2023
77
---
88

99
# Debug WASB file operations in Azure HDInsight
1010

1111
There are times when you may want to understand what operations the WASB driver started with Azure Storage. For the client side, the WASB driver produces logs for each file system operation at **DEBUG** level. WASB driver uses log4j to control logging level and the default is **INFO** level. For Azure Storage server-side analytics logs, see [Azure Storage analytics logging](../../storage/common/storage-analytics-logging.md).
1212

13-
A produced log will look similar to:
13+
A produced log looks similar to:
1414

1515
```log
1616
18/05/13 04:15:55 DEBUG NativeAzureFileSystem: Moving wasb://[email protected]/user/livy/ulysses.txt/_temporary/0/_temporary/attempt_20180513041552_0000_m_000000_0/part-00000 to wasb://[email protected]/user/livy/ulysses.txt/part-00000
@@ -34,7 +34,7 @@ A produced log will look similar to:
3434

3535
## Additional logging
3636

37-
The above logs should provide high-level understanding of the file system operations. If the above logs are still not providing useful information, or if you want to investigate blob storage api calls, add `fs.azure.storage.client.logging=true` to the `core-site`. This setting will enable the Java sdk logs for wasb storage driver and will print each call to blob storage server. Remove the setting after investigations because it could fill up the disk quickly and could slow down the process.
37+
The above logs should provide high-level understanding of the file system operations. If the above logs are still not providing useful information, or if you want to investigate blob storage api calls, add `fs.azure.storage.client.logging=true` to the `core-site`. This setting enables the Java SDK logs for wasb storage driver and print each call to blob storage server. Remove the setting after investigations because it could fill up the disk quickly and could slow down the process.
3838

3939
If the backend is Azure Data Lake based, then use the following log4j setting for the component(for example, spark/tez/hdfs):
4040

0 commit comments

Comments
 (0)