Skip to content

Commit 7c74eff

Browse files
schustmistrickvlgithub-actions[bot]
committed
Snapshot docs (#4023)
* Snapshot docs * Replace all mentions of run templates with snapshots * Update docs/book/how-to/snapshots/snapshots.md Co-authored-by: Alex Strick van Linschoten <[email protected]> * Some PR comment fixes * Change pics * Optimised images with calibre/image-actions * Apply suggestions from code review Co-authored-by: Alex Strick van Linschoten <[email protected]> * Core concept + code block fixes * Better snapshot description * Revert some links back to absolute --------- Co-authored-by: Alex Strick van Linschoten <[email protected]> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com> (cherry picked from commit 7ce5488)
1 parent fb52eab commit 7c74eff

28 files changed

+399
-471
lines changed
118 KB
Loading
52.8 KB
Loading
79.8 KB
Loading
-326 KB
Binary file not shown.
-159 KB
Binary file not shown.
-121 KB
Binary file not shown.
-3.41 MB
Binary file not shown.
19 KB
Loading

docs/book/api-docs/pro-api/pro-api/getting-started.md

Lines changed: 15 additions & 16 deletions
Original file line numberDiff line numberDiff line change
@@ -16,7 +16,7 @@ Whether you're using the [SaaS version](https://zenml.io/pro) or a self-hosted Z
1616

1717
ZenML Pro includes two distinct APIs:
1818

19-
1. **Workspace API**: This is similar to the [OSS API](../../oss-api/oss-api/) but includes additional endpoints like Run Templates. Each workspace in ZenML Pro has its own API.
19+
1. **Workspace API**: This is similar to the [OSS API](../../oss-api/oss-api/) but includes additional endpoints (for example to run snapshots). Each workspace in ZenML Pro has its own API.
2020
2. **ZenML Pro API**: This is the management API for ZenML Pro and handles organization-level resources like workspaces, users, and roles.
2121

2222
### Server URL
@@ -113,20 +113,20 @@ See the high‑level overview: [Connect to a server](https://docs.zenml.io/how-t
113113

114114
## Workspace API Authentication
115115

116-
The **Workspace API** is different from the ZenML Pro API and supports different authentication methods. This is the API you'll use for triggering run templates and other pipeline operations.
116+
The **Workspace API** is different from the ZenML Pro API and supports different authentication methods. This is the API you'll use for running snapshots and other pipeline operations.
117117
118118
### When to Use Which API
119119
120120
| Task | Use This API | Authentication Method |
121121
|------|-------------|----------------------|
122122
| Managing organizations, workspaces, users | **ZenML Pro API** (cloudapi.zenml.io) | Short-lived API tokens from organization settings |
123123
| Accessing the ZenML Pro API programmatically from external systems | **ZenML Pro API** (cloudapi.zenml.io) | Service accounts + API keys (recommended for automation) |
124-
| Triggering run templates, pipeline operations | **Workspace API** (your workspace URL) | Service accounts + API keys (recommended for automation) |
124+
| Running snapshots, pipeline operations | **Workspace API** (your workspace URL) | Service accounts + API keys (recommended for automation) |
125125
| Pipeline development, artifact management | **Workspace API** (your workspace URL) | Temporary API tokens or service accounts |
126126
127127
### Workspace API Authentication Methods
128128
129-
Programmatic access to the ZenML Pro workspace API is achieved mostly the same way as the ZenML OSS server API. This is because the Workspace API in ZenML Pro is an extension of the OSS API with some additional endpoints like Run Templates. The only exception is that workspace level service accounts and API keys are disabled and organization level service accounts and API keys are used instead (see [Service Accounts](https://docs.zenml.io/pro/core-concepts/service-accounts)).
129+
Programmatic access to the ZenML Pro workspace API is achieved mostly the same way as the ZenML OSS server API. This is because the Workspace API in ZenML Pro is an extension of the OSS API with some additional endpoints. The only exception is that workspace level service accounts and API keys are disabled and organization level service accounts and API keys are used instead (see [Service Accounts](https://docs.zenml.io/pro/core-concepts/service-accounts)).
130130
131131
You can use one of these two methods to authenticate with your workspace API:
132132
@@ -177,20 +177,19 @@ Remember to refer to the complete API documentation available at [https://clouda
177177
178178
The Workspace API includes all OSS API endpoints plus some additional Pro-specific endpoints. These are available at your workspace URL at the `/docs` path (e.g., https://1bfe8d94-zenml.cloudinfra.zenml.io/docs):
179179
180-
#### Run Templates (Pro-specific)
180+
#### Running snapshots (Pro-specific)
181181
182-
Run Templates allow you to trigger pipeline runs from external systems using HTTP requests.
182+
Snapshots allow you to start pipeline runs from external systems using HTTP requests.
183183
184-
* List run templates: `GET /run_templates`
185-
* Create a run template: `POST /run_templates`
186-
* Get run template details: `GET /run_templates/{template_id}`
187-
* Update a run template: `PATCH /run_templates/{template_id}`
188-
* **Trigger a run template: `POST /run_templates/{template_id}/runs`**
184+
* List snapshots: `GET /pipeline_snapshots`
185+
* Get snapshot details: `GET /pipeline_snapshots/<SNAPSHOT-ID>`
186+
* Update a snapshot: `PATCH /pipeline_snapshots/<SNAPSHOT-ID>`
187+
* **Run a snapshot: `POST /pipeline_snapshots/<SNAPSHOT-ID>/runs`**
189188
190189
{% hint style="success" %}
191-
**For Run Template Automation**
190+
**For Snapshot Automation**
192191
193-
When triggering run templates from external systems or CI/CD pipelines, we strongly recommend using **service accounts with API keys** rather than temporary tokens. Service accounts provide:
192+
When running snapshots from external systems or CI/CD pipelines, we strongly recommend using **service accounts with API keys** rather than temporary tokens. Service accounts provide:
194193
195194
* Long-term credentials that don't expire hourly
196195
* Dedicated authentication for automation (not tied to individual users)
@@ -217,7 +216,7 @@ Use this decision tree to determine the right approach:
217216

218217
| **What do you want to do?** | **Which API?** | **Authentication Method** | **Why?** |
219218
|------------------------------|----------------|---------------------------|----------|
220-
| Trigger run templates from CI/CD or external systems | **Workspace API** (your workspace URL) | Service account + API key | Long-lived, automation-friendly, not tied to users |
219+
| Run snapshots from CI/CD or external systems | **Workspace API** (your workspace URL) | Service account + API key | Long-lived, automation-friendly, not tied to users |
221220
| Manage organizations, create workspaces, invite users | **ZenML Pro API** (cloudapi.zenml.io) | Short-lived API tokens from org settings | Administrative operations need user-level permissions |
222221
| Access the ZenML Pro API programmatically from external systems | **ZenML Pro API** (cloudapi.zenml.io) | Service accounts + API keys (recommended for automation) | Long-lived, automation-friendly, not tied to users |
223222
| Develop pipelines, explore artifacts | **Workspace API** (your workspace URL) | Temporary API tokens or service accounts | Flexible for development needs |
@@ -234,6 +233,6 @@ Use this decision tree to determine the right approach:
234233
- ✅ Switch from temporary API tokens to service account API keys
235234
- ✅ Service account tokens don't expire automatically like user tokens
236235

237-
**"I can't find the run template endpoints"**
238-
- ✅ Run templates are only available on the **Workspace API**, not the ZenML Pro API
236+
**"I can't find the endpoint to run a snapshot"**
237+
- ✅ Running snapshots is only possible using the **Workspace API**, not the ZenML Pro API
239238
- ✅ Use your workspace URL + `/docs` to see the full API documentation

docs/book/getting-started/core-concepts.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -146,6 +146,10 @@ ZenML comes with a _Docker deployer_ that can run deployments on your local mach
146146

147147
A **Pipeline Run** is a record of a pipeline execution. When you run a pipeline using an orchestrator, a pipeline run is created tracking information about the execution such as the status, the artifacts and metadata produced by the pipeline and all its steps. When a pipeline is deployed for online mode execution, a pipeline run is similarly created for every HTTP request made to it.
148148

149+
#### Pipeline Snapshot
150+
151+
A **Pipeline Snapshot** is an immutable snapshot of your pipeline that includes the pipeline DAG, code, configuration, and container images. Snapshots can be run from the server or dashboard, and can also be [deployed](#deployment).
152+
149153
#### Artifact Store
150154

151155
An **Artifact Store** is a component that houses all data that passes through the pipeline as inputs and outputs. Each artifact that gets stored in the artifact store is tracked and versioned and this allows for extremely useful features like data caching, which speeds up your workflows.

0 commit comments

Comments
 (0)