Skip to content

Commit d791ea3

Browse files
committed
separated streaming config from small file cache config
1 parent 265f154 commit d791ea3

File tree

2 files changed

+31
-9
lines changed

2 files changed

+31
-9
lines changed

articles/storage/blobs/blobfuse2-how-to-deploy.md

Lines changed: 28 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -110,10 +110,10 @@ To build the BlobFuse2 binaries from source:
110110
You can configure BlobFuse2 with a variety of settings. Some of the common settings used include:
111111

112112
- Logging location and options
113-
- Temporary file path for caching or streaming
113+
- Temporary file path for caching
114114
- Information about the Azure storage account and blob container to be mounted
115115

116-
The settings can be configured in a yaml configuration file, using environment variables, or as parameters passed to the BlobFuse2 commands. The preferred method is to use the yaml configuration file.
116+
The settings can be configured in a yaml configuration file, using environment variables, or as parameters passed to the BlobFuse2 commands. The preferred method is to use the configuration file.
117117

118118
For details about all of the configuration parameters for BlobFuse2, consult the complete reference material for each:
119119

@@ -124,21 +124,41 @@ For details about all of the configuration parameters for BlobFuse2, consult the
124124

125125
The basic steps for configuring BlobFuse2 in preparation for mounting are:
126126

127-
1. [Configure a temporary path for caching or streaming](#configure-a-temporary-path-for-caching-or-streaming)
127+
1. [Configure caching](#configure-caching)
128128
1. [Create an empty directory for mounting the blob container](#create-an-empty-directory-for-mounting-the-blob-container)
129129
1. [Authorize access to your storage account](#authorize-access-to-your-storage-account)
130130

131-
### Configure a temporary path for caching or streaming
131+
### Configure caching
132132

133-
BlobFuse2 provides native-like performance by requiring a temporary path in the file system to buffer and cache any open files. For this temporary path, choose the most performant disk available, or use a ramdisk for the best performance.
133+
BlobFuse2 provides native-like performance by using local file-caching techniques. The caching configuration and behavior varies, depending on whether you are streaming large files or accessing smaller files.
134+
135+
#### Configure caching for streaming large files
136+
137+
In streaming mode, BlobFuse2 caches blocks of files in memory. The configuration settings related to caching for streaming are under the `stream:` settings in your configuration file as follows:
138+
139+
```configuration file
140+
stream:
141+
Block-size-mb:
142+
For read only mode, the size of each block to be cached in memory while streaming (in MB)
143+
For read/write mode: the size of newly created blocks
144+
Max-buffers: The total number of buffers to store blocks in
145+
Buffer-size-mb: The size for each buffer
146+
```
147+
148+
#### Configure caching for smaller files
149+
150+
Smaller files are cached to a temporary path specified under `file_cache:` in the configuration file as follows:
151+
152+
```configuration file
153+
file_cache:
154+
path: <path to local disk cache>
155+
```
134156
135157
> [!NOTE]
136158
> BlobFuse2 stores all open file contents in the temporary path. Make sure to have enough space to accommodate all open files.
137159
>
138160
139-
#### Choose a caching disk option
140-
141-
There are 3 common options for configuring the temporary path for caching:
161+
There are 3 common options for configuring the temporary path for file caching:
142162
143163
- [Use a local high-performing disk](#use-a-local-high-performing-disk)
144164
- [Use a ramdisk](#use-a-ramdisk)

articles/storage/blobs/blobfuse2-what-is.md

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -47,8 +47,9 @@ A full list of BlobFuse2 features is in the [BlobFuse2 README](https://github.co
4747

4848
- Mount an Azure storage blob container or Data Lake Storage Gen2 file system on Linux
4949
- Use basic file system operations, such as mkdir, opendir, readdir, rmdir, open, read, create, write, close, unlink, truncate, stat, and rename
50-
- Local caching to improve subsequent access times
50+
- Local file caching to improve subsequent access times
5151
- Streaming to support reading and writing large files
52+
- Gain insights into mount activities and resource usage using BlobFuse2 Health Monitor
5253
- Parallel downloads and uploads to improve access time for large files
5354
- Multiple mounts to the same container for read-only workloads
5455

@@ -59,6 +60,7 @@ Blobfuse2 has more feature support and improved performance in multiple user sce
5960
- Improved caching
6061
- More management support through new Azure CLI commands
6162
- Additional logging support
63+
- The addition of write-streaming for large files (read-streaming was previous supported)
6264
- Gain insights into mount activities and resource usage using BlobFuse2 Health Monitor
6365
- Compatibility and upgrade options for existing BlobFuse v1 users
6466
- Version checking and upgrade prompting

0 commit comments

Comments
 (0)