Skip to content

Commit b7edb9b

Browse files
authored
Merge pull request #78142 from j-martens/patch-496
Update how-to-save-write-experiment-files.md
2 parents e398d62 + e9aad47 commit b7edb9b

File tree

1 file changed

+5
-3
lines changed

1 file changed

+5
-3
lines changed

articles/machine-learning/service/how-to-save-write-experiment-files.md

Lines changed: 5 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,8 @@ Azure Machine Learning executes training scripts by copying the entire script fo
2929

3030
* **For large data and dependency files:** Store your files in an Azure Machine Learning [datastore](https://docs.microsoft.com/python/api/azureml-core/azureml.data?view=azure-ml-py). It has the advantages of accessing data from a remote compute target, which means things like authentication and mounting are managed by Azure Machine Learning service. Learn more about specifying a datastore as your source directory, and uploading files to your datastore in the [Access data from your datastores](how-to-access-data.md) article.
3131

32+
<a name="limits"></a>
33+
3234
### Storage limits of experiment snapshots
3335

3436
For experiments, Azure Machine Learning also makes an experiment snapshot of your code based on the directory you suggest when you configure the run. This has a total limit of 300 MB and/or 2000 files. If you exceed this limit, you'll see the following error:
@@ -40,11 +42,11 @@ Your total snapshot size exceeds the limit of 300.0 MB
4042

4143
Try one of the following solutions to resolve the error.
4244

43-
Experiment requirement|Storage limit solution
45+
Experiment&nbsp;requirement|Storage limit solution
4446
---|---
4547
Very large files| Move files to a datastore, and specify the datastore as your source_directory to prevent latency issues when the script folder is copied to the compute target environment at runtime.
4648
Many/ large files, but don't want a datastore| Override limit by setting SNAPSHOT_MAX_SIZE_BYTES to whatever your experiment needs. <br> `azureml._restclient.snapshots_client.SNAPSHOT_MAX_SIZE_BYTES = 'insert_desired_size'`
47-
Must use specific script directory| Make an ignore file (`.gitignore` or `.amlignore`) to prevent files from being included in the experiment snapshot that are not really a part of the source code. Place this file in the directory and add the files names to ignore to it. The `.amlignore` file uses the same syntax and patterns as the `.gitignore` file. If both files exist, the `.amlignore` file takes precedence.
49+
Must use specific script directory| Make an ignore file (`.gitignore` or `.amlignore`) to prevent files from being included in the experiment snapshot that are not really a part of the source code. Place this file in the directory and add the files names to ignore in it. The `.amlignore` file uses the same syntax and patterns as the `.gitignore` file. If both files exist, the `.amlignore` file takes precedence.
4850
Pipeline|Use a different subdirectory for each step or create an ignore file.
4951
Jupyter notebooks| You are likely using a directory that has more than 300 MB worth of data or files inside. Move your notebook into a new, empty, subdirectory with the following steps. <br> 1. Create a new folder.<br> 2. Move Jupyter notebook into empty folder. <br> 3. Run the code again.
5052

@@ -67,4 +69,4 @@ Write files to one of the following:
6769

6870
* Learn more about [accessing data from your datastores](how-to-access-data.md).
6971

70-
* Learn more about [How to Set Up Training Targets](how-to-set-up-training-targets.md).
72+
* Learn more about [How to Set Up Training Targets](how-to-set-up-training-targets.md).

0 commit comments

Comments
 (0)