Updated installation instructions (#32)

* Add and restructure documentation for RFdiffusion2

Introduces new documentation files including installation instructions, overview, and links to README and license. Updates Sphinx configuration to include sphinx-copybutton and reorganizes index.rst for improved navigation. The GitHub workflow now installs sphinx-copybutton. README updated with a link to the documentation site.

* Add sphinx-new-tab-link and update documentation overview

Added the sphinx-new-tab-link extension to the Sphinx build process and configuration. Updated overview.md with a detailed explanation of RFdiffusion2's capabilities and differences from the original RFdiffusion, and excluded overview.md from Sphinx build patterns.

* Update and expand documentation for RFdiffusion2

Improved the README with clearer setup, installation, and inference instructions, and added troubleshooting tips. Expanded the documentation by adding new usage examples, configuration options, and ORI token explanations. Updated Sphinx configuration and index to include new documentation files, and adjusted workflow and dependencies to comment out unused Sphinx extensions. Enhanced installation guide with troubleshooting for Apptainer image issues and clarified instructions for both Apptainer and source installations.

* Add CUDA 12.1/12.4 environment setup files

Introduced conda environment YAMLs and pip requirements for CUDA 12.1 and 12.4 support in the 'envs' directory. Updated installation documentation to guide users on using these files and troubleshooting environment setup. Minor README correction for pipeline argument.

* Update envs/requirements_cuda121.txt

Co-authored-by: Copilot <[email protected]>

* Update envs/cuda124_env.yml

Co-authored-by: Copilot <[email protected]>

* Update envs/cuda121_env.yml

Co-authored-by: Copilot <[email protected]>

* Update doc/source/installation.md

Co-authored-by: Copilot <[email protected]>

* Update doc/source/installation.md

Co-authored-by: Copilot <[email protected]>

* Update doc/source/conf.py

Co-authored-by: Copilot <[email protected]>

* Fix formatting and spelling in README.md

* Update README.md

Co-authored-by: Copilot <[email protected]>

* Update README.md

Co-authored-by: Copilot <[email protected]>

---------

Co-authored-by: Copilot <[email protected]>

Author: rclune

README.md

@@ -1,7 +1,7 @@
 > 🚧 **Under Construction:**  
 > This is an initial release of the functionality — further documentation and cleanup is in progress.  Currently only inference is supported. But everything currently documented in this README should be runnable. If you are experiencing a bug with inference, feel free to file an issue and attach the output .pdb, .trb, **and** a picture of the design visualized according to the pymol visualization section of this README.
 
-# RFdiffusion 2
+# RFdiffusion2
 
 Open source code for RFdiffusion2 as described in the following pre-print.
 
@@ -18,7 +18,24 @@ Open source code for RFdiffusion2 as described in the following pre-print.
 
 More detailed information about how to run, install, and use RFdiffusion2 can be found [here](https://rosettacommons.github.io/RFdiffusion2/). 
 
-## Set-up
+<!-- ## Table of Contents
+- [Setup](readme_link.html#setup)
+- [Inference Example](readme_link.html#inference)
+- [Viewing Designs](readme_link.html#viewing-designs)
+  - [PyMOL and designs on the same machine](readme_link.html#same_machine_pymol)
+  - [PyMOL running locally, designs on remote GPU](readme_link.html#remote_machine_pymol)
+- [Additional Info](readme_link.html#additional_info)
+  - [Running the AME benchmark](readme_link.html#ame_benchmark)
+  - [Pipeline metrics](readme_link.html#pipeline_metrics)
+    - [RFdiffusion2 outputs](readme_link.html#rfdiffusion2_outputs)
+    - [LigandMPNN outputs](readme_link.html#ligandmpnn_outputs)
+-->
+
+## Setup
+<a id="setup"></a>
+
+If these setup instructions do not work for your system see the [Installation Guide](installation.html) for troubleshooting issues with the
+provided image and alternative instructions for how to install RFdiffusion2 from source. 
 
 1. **Clone the repo.**
 
@@ -28,6 +45,7 @@ More detailed information about how to run, install, and use RFdiffusion2 can be
    ```bash
    export PYTHONPATH="/my/path/to/RFdiffusion2"
    ```
+   You will need to export this variable every time you use RFdiffusion2.
 
 3. **Download the model weights and containers:**
    ```bash
@@ -36,12 +54,12 @@ More detailed information about how to run, install, and use RFdiffusion2 can be
    ```
    These files are quite large so the download process can take over half an hour. If the download process gets terminated before finishing run `python setup.py overwrite` so that any partially downloaded files can be overwritten. 
 
-4. **Install apptainer**
+4. **Install Apptainer**
 
-   *Note: you can also run RFdiffusion2 with singularity.*
+   *Note: You can also run RFdiffusion2 with [Singularity](https://sylabs.io/singularity/).*
 
-   RFdiffusion2 (RFD2) uses [apptainer](https://apptainer.org) to simplify the environment set-up.
-   If you do not already have apptainer on your system, please follow the apptainer [installation instructions](https://apptainer.org/docs/admin/main/installation.html) for your operating system.
+   RFdiffusion2 (RFD2) uses [Apptainer](https://apptainer.org) to simplify the environment setup.
+   If you do not already have Apptainer on your system, please follow the [Apptainer installation instructions](https://apptainer.org/docs/admin/main/installation.html) for your operating system.
 
    If you manage your packages on linux with `apt` you can simply run:
    ```bash
@@ -60,19 +78,26 @@ More detailed information about how to run, install, and use RFdiffusion2 can be
    apptainer exec --nv exec/bakerlab_rf_diffusion_aa.sif <path-to-python_file> <args>
    ```
 
+## Inference Example
+<a id="inference"></a>
 
-## Inference
+For other usage examples, see the [Usage page](rosettacommons.github.io/RFdiffusion2/usage/usage.html) in the external documentation. 
 
-To run a demo of some of the inference capabilities, including enzyme design from an atomic motif + small molecule, enzyme design from an atomic motif of unknown sequence positions + small molecule, and small-molecule binder design (with RASA conditioning to enforce burial of the small molecule).  
-(See `rf_diffusion/benchmark/demo.json` for how these tasks are declared.)  Note that this will be extremely slow if not run on a GPU.
+The below commands run several demos that show off some of the inference capabilities of RFdiffusion2 including: 
+- enzyme design from an atomic motif and small molecule
+- enzyme design from an atomic motif of unknown sequence positions and a small molecule
+- small-molecule binder design with RASA conditioning 
+The possible demo options can be found in `rf_diffusion/benchmark/open_source_demo.json` which also shows the different inference configurations
+used in each demo. Note that this will be extremely slow if not run on a GPU.
 
-The default argument `in_proc=True` in `open_source_demo.yaml` makes the script run locally. With `in_proc=False` the pipeline will automatically distribute the tasks using SLURM, but this is not yet supported.  
+<!--The default argument `in_proc=True` in `open_source_demo.yaml` makes the script run locally. With `in_proc=False` the pipeline will automatically distribute the tasks using SLURM, but this is not yet supported.-->  
 The demo generates 150 residue proteins with many of the residues atomized, so it can take upwards of 30 minutes to run all cases.  Each case may take up to 10 minutes on an RTX2060.
 
 **Run single demo case:**
 ```bash
 apptainer exec --nv rf_diffusion/exec/bakerlab_rf_diffusion_aa.sif rf_diffusion/benchmark/pipeline.py --config-name=open_source_demo sweep.benchmarks=active_site_unindexed_atomic_partial_ligand
 ```
+You can replace `active_site_unindexed_atomic_partial_ligand` with any of the other demos included in `rf_diffusion/benchmark/open_source_demo.json`.
 
 **Run all demo cases:**
 ```bash
@@ -83,23 +108,26 @@ The outputs will be written to:
 ```
 pipeline_outputs/${now:%Y-%m-%d}_${now:%H-%M-%S}_open_source_demo
 ```
+in the directory that you are running the image file from. 
 
-This runs only the design stage of the pipeline.  In order to continue through sequence-fitting with [LigandMPNN](https://github.com/dauparas/LigandMPNN) and folding with [Chai1](https://github.com/chaidiscovery/chai-lab), pass the command line argument: `stop_step=''`.  Note that Chai1 cannot run on all GPU architectures.
+This runs only the design stage of the pipeline.  In order to continue through sequence-fitting with [LigandMPNN](https://github.com/dauparas/LigandMPNN) and folding with [Chai1](https://github.com/chaidiscovery/chai-lab), pass the command line argument: `stop_step='end'`.  Note that Chai1 cannot run on all GPU architectures.
 
 Pipeline runs can be resumed by passing `outdir=/path/to/your/output/directory`.
 
 
 ## Viewing Designs
+<a id="viewing-designs"></a>
 
 Visualizing the design outputs can be confusing when looking at the raw .pdb files, especially for unindexed motif scaffolding, in which the input motif is incorporated into the protein at indices of the network's choice.  
 To simplify this, we provide scripts for visualizing the outputs of the network that interact with a local PyMOL instance over XMLRPC.
 
-Download [PyMOL](https://www.pymol.org/) and run it as an XMLRPCServer with:
+Download [PyMOL](https://www.pymol.org/) and run it as an XML-RPC server with:
 ```bash
 pymol -R
 ```
 
 ### PyMOL and designs on the same machine
+<a id="same_machine_pymol"></a>
 
 Run:
 ```bash
@@ -119,27 +147,39 @@ You should see something like:
 - Any small molecules will have their carbon atoms colored purple.
 
 ### PyMOL running locally, designs on remote GPU
+<a id="remote_machine_pymol"></a>
 
 It is common for users to be sshed into a gpu cluster for running designs.  
 It is still possible to view designs on a remote computer from your local PyMOL, as long as your remote computer has a route to your local computer (via VPN or ssh proxy).
 
-Simply find your hostname on your cluster with:
-```bash
-hostname -I
-192.168.0.113 100.64.128.68
+You will need to know an IP address that will point back to your computer, typically you can use 127.0.0.1.
+
+You will also need to add the -R option when you are signing into your cluster and provide the path back to your PyMOL server:
+```
+ssh username@hostname -R 9123:localhost:9123
 ```
+You do **not** need to replace `localhost` with an IP address. The 9123 is the port that should have been printed in the PyMOL terminal
+when you first set up the XML-RPC server.
 
-The second number is the route to your computer.
+If you need to sign into multiple servers before you can run Apptainer, you will need to sign into your cluster like this:
+```
+ssh -J username@first_hostname username@second_hostname -R 9123:localhost:9123
+```
+The -J option stands for 'jump host' and allows you to connect to a remote host through an intermediate server in one command.
 
-Simply append `--pymol_url=http://100.64.128.68:9123` to the command, i.e. from your remote machine (cluster) run:
+Simply append `--pymol_url=http://127.0.0.1:9123` to the command, i.e. from your remote machine (cluster) run:
 ```bash
-apptainer exec rf_diffusion/exec/bakerlab_rf_diffusion_aa.sif rf_diffusion/dev/show_bench.py --clear=True --key=name '/absolute/path/to/pipeline_outputs/output_directory/*.pdb' --pymol_url=http://100.64.128.68:9123
+apptainer exec rf_diffusion/exec/bakerlab_rf_diffusion_aa.sif rf_diffusion/dev/show_bench.py --clear=True --key=name '/absolute/path/to/pipeline_outputs/output_directory/*.pdb' --pymol_url=http://127.0.0.1:9123
 ```
-Make sure to replace 100.64.128.68 with your computer's route. 9123 is the port that PyMol uses, after running `pymol -R` you should see a message containing this route number. 
+If 127.0.0.1 does not point to your local machine, replace it in all the above steps in this section with an IP address that does point to your machine.  
+
+For more information about using PyMOL remotely, see this blog post on [Controlling PyMOL from afar](https://www.blopig.com/blog/2024/11/controlling-pymol-from-afar/).
 
-## Additional Info
+## Additional Information
+<a id="additional_info"></a>
 
-### Running the AME Benchmark
+### Running the AME benchmark
+<a id="ame_benchmark"></a>
 
 We crawled M-CSA for 41 enzymes where all reactants and products are present to create this benchmark.  
 Only positon-agnostic tip atoms are provided to the network. 100 designs for each case are created. Run it with:
@@ -148,7 +188,8 @@ apptainer exec --nv rf_diffusion/exec/bakerlab_rf_diffusion_aa.sif rf_diffusion/
 ```
 Running this entire benchmark will perform [41 active sites * 100 designs per active site * 8 sequences per design] chai folding runs, which will take a prohibitively long time on a single machine, but for reproducibility it is included.
 
-### Pipeline Metrics
+### Pipeline metrics
+<a id="pipeline_metrics"></a>
 
 We also include the code that was used to benchmark the network.  
 The outline of the benchmarking process is:
@@ -178,7 +219,8 @@ Where:
   - `full_atom`: All heavy atoms
   - `motif_atom`: Only motif heavy atoms
 
-#### RFdiffusion2 Outputs
+#### RFdiffusion2 outputs
+<a id="rfdiffusion2_outputs"></a>
 
 The network outputs the protein with both the indexed backbone region and the unindexed atomized region.  
 After that several idealization steps are conducted; the backbone is idealized, the protein is deatomized and the unindexed residues are assigned their corresponding indexed residue (using a greedy algorithm that searches for the closest C-alpha in the indexed backbone).
@@ -189,7 +231,8 @@ There are two further idealization steps that are optional to users:
 
 The protein at this point has sequence and structure for the motif regions but only backbone (N,Ca,C,O,C-Beta) coordinates for diffused residues (as well as any non-protein components e.g. small molecules).
 
-#### LigandMPNN Outputs
+#### LigandMPNN outputs
+<a id="ligandmpnn_outputs"></a>
 
 Sequence is fit using LigandMPNN in a ligand-aware, motif-rotamer-aware mode. LigandMPNN also performs packing. LigandMPNN attempts to keep the motif rotamers unchanged, however the pack uses a more conservative set of torsions than RF All-Atom (i.e. fewer DoF) to pack the rotamers and thus there is often some deviation between the RF All-Atom-idealized and ligandmpnn-idealized motif rotamers. The idealization gap between the diffusion-output rotamer set and the RF All-Atom-idealized rotamer set can be found with metrics key: `metrics.IdealizedResidueRMSD.rmsd_constellation`. The corresponding gap between the rf2aa-idealized (or not idealized if `inference.idealize_sidechain_outputs == False`) rotamer set and the ligandmpnn-idealized rotamer set can be found with metrics key: `motif_ideality_diff`.
 

doc/source/conf.py

@@ -21,7 +21,7 @@
     'sphinx_mdinclude',
     #'myst_parser', # to use markdown instead of ReST
     'sphinx_copybutton',
-    'sphinx_new_tab_link',
+    #'sphinx_new_tab_link',
 ]
 
 #myst_enable_extensions = ["colon_fence"] # see https://mystmd.org/guide/syntax-overview for more information
@@ -64,7 +64,7 @@
 napoleon_use_ivar = True
 
 templates_path = ['_templates']
-exclude_patterns = ['_build', 'Thumbs.db', '.DS_Store', 'overview.md']
+exclude_patterns = ['_build', 'Thumbs.db', '.DS_Store', 'overview.md', 'usage/run_inference_example.md', 'usage/other_pipeline_example.md']
 
 # -- Options for HTML output -------------------------------------------------
 # https://www.sphinx-doc.org/en/master/usage/configuration.html#options-for-html-output
@@ -75,8 +75,6 @@
 
 html_theme_options = {
     "sidebar_hide_name":False,
-    "top_of_page_buttons": ["edit"],
-    ""
     #"announcement": "<em>THIS DOCUMENTATION IS CURRENTLY UNDER CONSTRUCTION</em>",
     "light_css_variables": {
         "color-brand-primary": "#F68A33", # Rosetta Teal

doc/source/index.rst

@@ -15,6 +15,16 @@ Welcome to the Official Documentation for `RFdiffusion2 <https://github.com/Rose
    readme_link.rst
    license_link.rst
    installation.md
+   usage/usage.md
+   usage/configuration_options.md
+   usage/ori_tokens.md
+
+.. toctree::
+   :maxdepth: 1
+   :hidden:
+
+..   usage/other_pipeline_example.md
+..   usage/run_inference_example.md
 
 .. Indices and tables
 .. ==================