You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: docs/hpc/06_tools_and_software/02_conda_environments.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -29,7 +29,7 @@ One of the ways to ensure the reproducibility of your results is to have an inde
29
29
30
30
### Disadvantages
31
31
32
-
- Conda does not take advantage of packages already installed in the system (while [virtualenv and venv](./python_packages_with_virtual_environments.md) do)
32
+
- Conda does not take advantage of packages already installed in the system (while [virtualenv and venv](./03_python_packages_with_virtual_environments.md) do)
33
33
- As you will see below, you may need to do additional steps to keep track of all installed packages (including those installed by pip and/or install.packages)
34
34
35
35
## Initializing Conda
@@ -42,15 +42,15 @@ module load anaconda3/2020.07
42
42
Conda init can create problems with package installation, so we suggest using `source activate` instead of `conda activate`, even though conda activate is considered a best practice by the Anaconda developers.
43
43
44
44
### Automatic deletion of your files
45
-
This page describes the installation of packages on /scratch. One has to remember, though, that files stored in the HPC scratch file system are subject to the HPC Scratch old file purging policy: Files on the /scratch file system that have not been accessed for 60 or more days will be purged (read more about [Data Management](./data_management.md).
45
+
This page describes the installation of packages on /scratch. One has to remember, though, that files stored in the HPC scratch file system are subject to the HPC Scratch old file purging policy: Files on the /scratch file system that have not been accessed for 60 or more days will be purged (read more about [Data Management](../03_storage/06_data_management.md).
46
46
47
47
Thus you can consider the following options
48
48
49
49
- Reinstall your packages if some of the files get deleted
50
50
- You can do this manually
51
51
- You can do this automatically. For example, within a workflow of a pipeline software like [Nextflow](https://www.nextflow.io/)
52
-
- Pay for "Research Project Space" - read more [here](./research_project_space.md)
53
-
- Use Singularity and install packages within a corresponding overlay file - read more [here](./singularity_with_conda.md)
52
+
- Pay for "Research Project Space" - read more [here](../03_storage/05_research_project_space.md)
53
+
- Use Singularity and install packages within a corresponding overlay file - read more [here](../07_containers/03_singularity_with_conda.md)
54
54
55
55
## Python
56
56
Load anaconda module
@@ -180,7 +180,7 @@ Conda + pakcrat: specific version of R and install.packages (R)
180
180
- do not use 'conda install' at all
181
181
- use renv
182
182
- install all the packages using install.packages
183
-
- use [renv as described here](./r_packages_with_renv.md) to keep track of the environment
183
+
- use [renv as described here](../09_ood/r_packages_with_renv.md) to keep track of the environment
184
184
185
185
In order for conda + renv to work, you need to add following steps:
This page describes the installation of packages on /scratch. One has to remember, though, that files stored in the HPC scratch file system are subject to the HPC Scratch old file purging policy: Files on the /scratch file system that have not been accessed for 60 or more days will be purged (read [more](./data_management.md)).
28
+
This page describes the installation of packages on /scratch. One has to remember, though, that files stored in the HPC scratch file system are subject to the HPC Scratch old file purging policy: Files on the /scratch file system that have not been accessed for 60 or more days will be purged (read [more](../03_storage/06_data_management.md)).
29
29
30
30
Thus you can consider the following options
31
31
32
32
- Reinstall your packages if some of the files get deleted
33
33
- You can do this manually
34
34
- You can do this automatically. For example, within a workflow of a pipeline software like [Nextflow](https://www.nextflow.io/)
35
-
- Pay for "Research Project Space" - read more [here](./research_project_space.md)
36
-
- Use Singularity and install packages within a corresponding overlay file - read more [here](./singularity_with_conda.md)
35
+
- Pay for "Research Project Space" - read more [here](../03_storage/05_research_project_space.md)
36
+
- Use Singularity and install packages within a corresponding overlay file - read more [here](../07_containers/03_singularity_with_conda.md)
37
37
38
38
## Create virtual environment
39
39
It is advisable to create private environment inside the project directory. This boosts reproducibility and does not use space in `/home/$USER`
Copy file name to clipboardExpand all lines: docs/hpc/09_ood/r_packages_with_renv.md
+3-3Lines changed: 3 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -28,15 +28,15 @@ R
28
28
```
29
29
30
30
### Automatic deletion of your files
31
-
This page describes the installation of packages on /scratch. One has to remember, though, that files stored in the HPC scratch file system are subject to the HPC Scratch old file purging policy: Files on the `/scratch` file system that have not been accessed for 60 or more days will be purged (read [more](./data_management.md)).
31
+
This page describes the installation of packages on /scratch. One has to remember, though, that files stored in the HPC scratch file system are subject to the HPC Scratch old file purging policy: Files on the `/scratch` file system that have not been accessed for 60 or more days will be purged (read [more](../03_storage/06_data_management.md)).
32
32
33
33
Thus you can consider the following options:
34
34
35
35
- Reinstall your packages if some of the files get deleted
36
36
- You can do this manually
37
37
- You can do this automatically. For example, within a workflow of a pipeline software like [Nextflow](https://www.nextflow.io/)
38
-
- Pay for "Research Project Space" - read more [here](./research_project_space.md)
39
-
- Use Singularity and install packages within a corresponding overlay file - read more [here](./singularity_with_conda.md)
38
+
- Pay for "Research Project Space" - read more [here](../03_storage/05_research_project_space.md)
39
+
- Use Singularity and install packages within a corresponding overlay file - read more [here](../07_containers/04_squash_file_system_and_singularity.md)
40
40
41
41
### Cache directory setup
42
42
By default, renv will cache package installation files to your home directory (most likely either in `~/.local/share/renv` or `~/.cache/R/renv/` or something similar).
0 commit comments