Skip to content

Commit 9c13278

Browse files
Merge pull request #970 from SturgeonMi/patch-2
Update how-to-read-write-data-v2.md
2 parents bcc6706 + bf24d89 commit 9c13278

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

articles/machine-learning/how-to-read-write-data-v2.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -516,7 +516,7 @@ You can tune the mount settings with these environment variables in your job:
516516
| `DATASET_MOUNT_ATTRIBUTE_CACHE_TTL` | u64 | Not set (cache never expires) | Time, in milliseconds, needed to keep the `getattr` call results in cache, and to avoid subsequent requests of this info from storage again. |
517517
| `DATASET_RESERVED_FREE_DISK_SPACE` | u64 | 150 MB | Intended for a system configuration, to keep compute healthy. No matter what values the other settings have, Azure Machine Learning data runtime doesn't use the last `RESERVED_FREE_DISK_SPACE` bytes of disk space. |
518518
|`DATASET_MOUNT_CACHE_SIZE` | usize | Unlimited | Controls how much disk space mount can use. A positive value sets absolute value in bytes. Negative value sets how much of a disk space to leave free. This table provides more disk cache options. Supports `KB`, `MB` and `GB` modifiers for convenience. |
519-
| `DATASET_MOUNT_FILE_CACHE_PRUNE_THRESHOLD` | f64 | 1.0 | Volume mount starts cache pruning when cache is filled up to `AVAILABLE_CACHE_SIZE * DATASET_MOUNT_FILE_CACHE_PRUNE_THRESHOLD`. Should be between 0 and 1. Setting it < 1 triggers background cache pruning earlier. |
519+
| `DATASET_MOUNT_FILE_CACHE_PRUNE_THRESHOLD` | f64 | 1.0 | Volume mount starts cache pruning when cache is filled up to `AVAILABLE_CACHE_SIZE * DATASET_MOUNT_FILE_CACHE_PRUNE_THRESHOLD`. Should be between 0 and 1. Setting it < 1 triggers background cache pruning earlier. `AVAILABLE_CACHE_SIZE` is not an environment variable you can modify or view directly. In this context, it refers to the "number of bytes the system calculates as available for caching." This value depends on factors such as disk size, the amount of disk space required for system health, and configurations set in environment variables (like `DATASET_RESERVED_FREE_DISK_SPACE` and `DATASET_MOUNT_CACHE_SIZE`). |
520520
| `DATASET_MOUNT_FILE_CACHE_PRUNE_TARGET` | f64 | 0.7 | Pruning cache tries to free at least (`1-DATASET_MOUNT_FILE_CACHE_PRUNE_TARGET`) of a cache space. |
521521
| `DATASET_MOUNT_READ_BLOCK_SIZE` | usize | 2 MB | Streaming read block size. When file is large enough, request at least `DATASET_MOUNT_READ_BLOCK_SIZE` of data from storage, and cache even when fuse requested read operation was for less. |
522522
| `DATASET_MOUNT_READ_BUFFER_BLOCK_COUNT` | usize | 32 | Number of blocks to prefetch (reading block *k* triggers background prefetching of blocks *k+1*, ..., *k.+`DATASET_MOUNT_READ_BUFFER_BLOCK_COUNT`*) |

0 commit comments

Comments
 (0)