Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
39 changes: 20 additions & 19 deletions platform-cloud/docs/reports/overview.md
Original file line number Diff line number Diff line change
@@ -1,25 +1,26 @@
---
title: "Reports"
description: "Overview of pipeline reports in Seqera Platform."
date: "24 Apr 2023"
tags: [pipeline, schema]
date: "2023-04-24"
last_update: "2025-09-12"
tags: [pipeline, schema, reports, configuration]
---

Most Nextflow pipelines will generate reports or output files which are useful to inspect at the end of the pipeline execution. Reports may be in various formats (e.g. HTML, PDF, TXT) and would typically contain quality control (QC) metrics that would be important to assess the integrity of the results.
Most Nextflow pipelines generate reports and output files that you can inspect after pipeline execution. Reports may be in various formats (e.g. HTML, PDF, TXT) and would typically contain quality control (QC) metrics that would be important to assess the integrity of the results.

**Reports** allow you to directly visualise supported file types or to download them via the user interface (see [Limitations](#limitations)). This saves users the time and effort of having to retrieve and visualize output files from their local storage.
**Reports** allow you to directly visualize supported file types or to download them via the user interface (see [Limitations](#limitations)). This saves users the time and effort of having to retrieve and visualize output files from their local storage.

### Visualize reports

Available reports are listed in a **Reports** tab on the **Runs** page. You can select a report from the table to view or download it (see [Limitations](#limitations) for supported file types and sizes).
You can find available reports in the **Reports** tab on the **Runs** page. You can select a report from the table to view or download it (see [Limitations](#limitations) for supported file types and sizes).

To open a report preview, the file must be smaller than 10 MB.

You can download a report directly or from the provided file path. Reports larger than 25MB cannot be downloaded directly — the option to download from file path is given instead.

### Configure reports

Create a config file that defines the paths to a selection of output files published by the pipeline for Seqera to render reports. There are 2 ways to provide the config file, both of which have to be in YAML format:
Create a configuration file that defines paths to output files that Seqera uses to render reports. There are 2 ways to provide the config file, both of which have to be in YAML format:

1. **Pipeline repository**: If a file called `tower.yml` exists in the root of the pipeline repository then this will be fetched automatically before the pipeline execution.
2. **Seqera Platform interface**: Provide the YAML definition within the **Advanced options > Seqera Cloud config file** box when:
Expand All @@ -30,21 +31,21 @@ Create a config file that defines the paths to a selection of output files publi
Any configuration provided in the interface will override configuration supplied in the pipeline repository.
:::

### Configure reports for Nextflow CLI runs
### Configure reports for Nextflow CLI runs

The reports and log files for pipeline runs launched with Nextflow CLI (`nextflow run <pipeline> -with-tower`) can be accessed directly in the Seqera UI. The files generated by the run must be accessible to your Seqera workspace primary compute environment. Specify your workspace prior to launch by setting the `TOWER_WORKSPACE_ID` environment variable. Reports are listed under the **Reports** tab on the run details page.
You can access reports and log files for pipeline runs launched with Nextflow CLI (`nextflow run <PIPELINE> -with-tower`) in the Seqera UI. The files generated by the run must be accessible to your Seqera workspace primary compute environment. Specify your workspace prior to launch by setting the `TOWER_WORKSPACE_ID` environment variable. Reports are listed under the **Reports** tab on the run details page.

Execution logs are available in the **Logs** tab by default, provided the output files are accessible to your workspace primary compute environment. To specify additional report files to be made available, your pipeline repository root folder must include a `tower.yml` file that specifies the files to be included (see below).
You can view execution logs in the **Logs** tab by default if output files are accessible to your workspace primary compute environment. To specify additional report files to be made available, your pipeline repository root folder must include a `tower.yml` file that specifies the files to be included (see below).

### Reports implementation

Pipeline reports need to be specified using YAML syntax:

```yaml
reports:
<path pattern>:
display: text to display (required)
mimeType: file mime type (optional)
<PATH_PATTERN>:
display: <DISPLAY_TEXT> (required)
mimeType: <MIME_TYPE> (optional)
```

### Path pattern
Expand All @@ -56,7 +57,7 @@ Examples of valid path patterns are:
- `multiqc.html`: This will match all the published files with this name.
- `**/multiqc.html`: This is a glob expression that matches any subfolder. It's equivalent to the previous expression.
- `results/output.txt`: This will match all the `output.txt` files inside any `results` folder.
- `*_output.tsv`: This will match any file that ends with `\_output.tsv`.
- `*_output.tsv`: This will match any file that ends with `_output.tsv`.

:::caution
To use `*` in your path pattern, you must wrap the pattern in double quotes for valid YAML syntax.
Expand All @@ -72,11 +73,11 @@ reports:
display: "Data sheet"
```

For paths `/workdir/sample1/out/sheet.tsv` and `/workdir/sample2/out/sheet.tsv`, both match the path pattern. The final display name will for these paths will be _Data sheet (sample1)_ and _Data sheet (sample2)_.
For paths `/workdir/sample1/out/sheet.tsv` and `/workdir/sample2/out/sheet.tsv`, both match the path pattern. The final display name for these paths will be _Data sheet (sample1)_ and _Data sheet (sample2)_.

### MIME type

By default, the MIME type is deduced from the file extension, so you don't need to explicitly define it. Optionally, you can define it to force a viewer, for example showing a `txt` file as a `tsv`. It is important that it is a valid MIME-type text, otherwise it will be ignored and the extension will be used instead.
By default, Seqera deduces the MIME type from the file extension, so you don't need to explicitly define it. Optionally, you can define it to force a viewer, for example showing a `txt` file as a `tsv`. It is important that it is a valid MIME-type text, otherwise it will be ignored and the extension will be used instead.

### Built-in reports

Expand All @@ -85,9 +86,9 @@ Nextflow can generate a number of built-in reports:
- [Execution report](https://nextflow.io/docs/latest/tracing.html#execution-report)
- [Execution timeline](https://nextflow.io/docs/latest/tracing.html#timeline-report)
- [Trace file](https://nextflow.io/docs/latest/tracing.html#trace-report)
- [Workflow diagram](https://nextflow.io/docs/latest/tracing.html#dag-visualisation) (i.e. DAG)
- [Workflow diagram](https://nextflow.io/docs/latest/tracing.html#dag-visualisation)

In Nextflow version 24.03.0-edge and later, these reports can be included as pipeline reports in Seqera Platform. Specify them in `tower.yml` like any other file:
In Nextflow version 24.03.0-edge and later, you can include these reports as pipeline reports in Seqera Platform. Specify them in `tower.yml` like any other file:

```yaml
reports:
Expand All @@ -113,8 +114,8 @@ The filenames must match any custom filenames defined in the Nextflow config:

### Limitations

The current reports implementation limits rendering to the following formats: `HTML`, `csv`, `tsv`, `pdf`, and `txt`. In-page rendering/report preview is restricted to files smaller than 10 MB. Larger files need to be downloaded first.
Seqera currently limits report rendering to the following formats: `HTML`, `CSV`, `TSV`, `PDF`, and `TXT`. In-page rendering/report preview is restricted to files smaller than 10 MB. Larger files need to be downloaded first.

The download is restricted to files smaller than 25 MB. Files larger than 25 MB need to be downloaded from the path.

YAML formatting validation checks both the `tower.yml` file inside the repository and the UI configuration box. The validation phase will produce an error message if you try to launch a pipeline with non-compliant YAML definitions.
Seqera validates YAML formatting for both the `tower.yml` file in the repository and the UI configuration box. Seqera displays an error message if you try to launch a pipeline with invalid YAML definitions.
37 changes: 19 additions & 18 deletions platform-cloud/docs/resource-labels/overview.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,8 @@
---
title: "Resource labels"
description: "Instructions to use resource labels in Seqera Platform."
date: "24 Apr 2023"
date: "2023-04-24"
last_update: "2025-08-12"
tags: [resource labels, labels]
---

Expand All @@ -21,7 +22,7 @@ Resource labels can be created, applied, and edited by a workspace admin or owne

Admins can assign a set of resource labels when creating a compute environment. All runs executed using the compute environment will be tagged with its resource labels. Resource labels applied to a compute environment are displayed on the compute environment details page.

Apply resource labels when you create a new compute environment.
To apply resource labels, add them when you create a new compute environment.

:::info
Once the compute environment has been created, its resource labels cannot be edited.
Expand All @@ -45,11 +46,11 @@ If a maintainer changes the compute environment associated with a pipeline or ru

### Search and filter with resource labels

Search and filter pipelines and runs using one or more resource labels. The resource label search uses a `label:key=value` format.
To search and filter pipelines and runs, use one or more resource labels in the `label:key=value` format.

### Manage workspace resource labels

Select a workspace's **Settings** tab to view all the resource labels used in that workspace. All users can add resource labels, but only admins can edit or delete them, provided they're not already associated with **any** resource. This applies to resource labels associated with compute environments and runs.
Select a workspace's **Settings** tab to view all the resource labels used in that workspace. All users can add resource labels, but only admins can edit or delete them, provided they're not already associated with **any** resource. This applies to resource labels associated with compute environments and runs.

When you add or edit a resource label, you can optionally set **Use as default in compute environment form**. Workspace default resource labels are prefilled in the **Resource labels** field when you create a new compute environment in that workspace.

Expand Down Expand Up @@ -118,14 +119,14 @@ To include the cost information associated with your resource labels in your AWS
#### AWS limits

- Resource label keys and values must contain a minimum of 2 and a maximum of 39 alphanumeric characters (each), separated by dashes or underscores.
- The key and value cannot begin or end with dashes `-` or underscores `_`.
- The key and value cannot contain a consecutive combination of `-` or `_` characters (`--`, `__`, `-_`, etc.)
- Keys and values cannot begin or end with dashes `-` or underscores `_`.
- Keys and values cannot contain consecutive `-` or `_` characters (`--`, `__`, `-_`, etc.)
- A maximum of 25 resource labels can be applied to each resource.
- A maximum of 1000 resource labels can be used in each workspace.
- Keys and values cannot start with `aws` or `user`, as these are reserved prefixes appended to tags by AWS.
- Keys and values are case-sensitive in AWS.

See [here](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/Using_Tags.html#tag-restrictions) for more information on AWS resource tagging.
For more resource tagging information, see [Tag restrictions](https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/Using_Tags.html#tag-restrictions).

### Google Cloud

Expand All @@ -143,33 +144,33 @@ The following resources are tagged using the labels associated with the compute
#### GCP limits

- Resource label keys and values must contain a minimum of 2 and a maximum of 39 alphanumeric characters (each), separated by dashes or underscores.
- The key and value cannot begin or end with dashes `-` or underscores `_`.
- The key and value cannot contain a consecutive combination of `-` or `_` characters (`--`, `__`, `-_`, etc.)
- Keys and values cannot begin or end with dashes `-` or underscores `_`.
- Keys and values cannot contain consecutive `-` or `_` characters (`--`, `__`, `-_`, etc.)
- A maximum of 25 resource labels can be applied to each resource.
- A maximum of 1000 resource labels can be used in each workspace.
- Keys and values in Google Cloud Resource Manager may contain only lowercase letters. Resource labels created with uppercase characters are changed to lowercase before propagating to Google Cloud.

See [here](https://cloud.google.com/resource-manager/docs/creating-managing-labels#requirements) for more information on Google Cloud Resource Manager labeling.
For more Google Cloud Resource Manager labeling information, see [Requirements](https://cloud.google.com/resource-manager/docs/creating-managing-labels#requirements).

### Azure

:::note
The labeling system on Azure Cloud uses the term metadata to refer to resource and other labels
:::

When creating an Azure Batch compute environment with Forge, resource labels are added to the Pool parameters — this adds set of `key=value` metadata pairs to the Azure Batch Pool.
When you create an Azure Batch compute environment with Forge, resource labels are added to the Pool parameters. This adds a set of `key=value` metadata pairs to the Azure Batch Pool.

#### Azure limits

- Resource label keys and values must contain a minimum of 2 and a maximum of 39 alphanumeric characters (each), separated by dashes or underscores.
- The key and value cannot begin or end with dashes `-` or underscores `_`.
- The key and value cannot contain a consecutive combination of `-` or `_` characters (`--`, `__`, `-_`, etc.)
- Keys and values cannot begin or end with dashes `-` or underscores `_`.
- Keys and values cannot contain consecutive `-` or `_` characters (`--`, `__`, `-_`, etc.)
- A maximum of 25 resource labels can be applied to each resource.
- A maximum of 1000 resource labels can be used in each workspace.
- Keys are case-insensitive, but values are case-sensitive.
- Microsoft advises against using a non-English language in your resource labels, as this can lead to decoding progress failure while loading your VM's metadata.
- Microsoft advises against using a non-English language in your resource labels, as this can cause decoding failures when loading your VM metadata.

See [here](https://learn.microsoft.com/en-us/azure/azure-resource-manager/management/tag-resources?tabs=json) for more information on Azure Resource Manager tagging.
For more information, see [Azure Resource Manager tagging](https://learn.microsoft.com/en-us/azure/azure-resource-manager/management/tag-resources?tabs=json).

### Kubernetes

Expand Down Expand Up @@ -197,9 +198,9 @@ The following resources will be tagged using the labels associated with the comp
#### Kubernetes limits

- Resource label keys and values must contain a minimum of 2 and a maximum of 39 alphanumeric characters (each), separated by dashes or underscores.
- The key and value cannot begin or end with dashes `-` or underscores `_`.
- The key and value cannot contain a consecutive combination of `-` or `_` characters (`--`, `__`, `-_`, etc.)
- Keys and values cannot begin or end with dashes `-` or underscores `_`.
- Keys and values cannot contain consecutive `-` or `_` characters (`--`, `__`, `-_`, etc.)
- A maximum of 25 resource labels can be applied to each resource.
- A maximum of 1000 resource labels can be used in each workspace.

See [Syntax and character set](https://kubernetes.io/docs/concepts/overview/working-with-objects/labels/#syntax-and-character-set) for more information on Kubernetes object labeling.
For more information, see [Kubernetes label syntax and character set](https://kubernetes.io/docs/concepts/overview/working-with-objects/labels/#syntax-and-character-set).
Loading
Loading