You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
* Snapshot docs
* Replace all mentions of run templates with snapshots
* Update docs/book/how-to/snapshots/snapshots.md
Co-authored-by: Alex Strick van Linschoten <[email protected]>
* Some PR comment fixes
* Change pics
* Optimised images with calibre/image-actions
* Apply suggestions from code review
Co-authored-by: Alex Strick van Linschoten <[email protected]>
* Core concept + code block fixes
* Better snapshot description
* Revert some links back to absolute
---------
Co-authored-by: Alex Strick van Linschoten <[email protected]>
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
(cherry picked from commit 7ce5488)
Copy file name to clipboardExpand all lines: docs/book/api-docs/pro-api/pro-api/getting-started.md
+15-16Lines changed: 15 additions & 16 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -16,7 +16,7 @@ Whether you're using the [SaaS version](https://zenml.io/pro) or a self-hosted Z
16
16
17
17
ZenML Pro includes two distinct APIs:
18
18
19
-
1.**Workspace API**: This is similar to the [OSS API](../../oss-api/oss-api/) but includes additional endpoints like Run Templates. Each workspace in ZenML Pro has its own API.
19
+
1.**Workspace API**: This is similar to the [OSS API](../../oss-api/oss-api/) but includes additional endpoints (for example to run snapshots). Each workspace in ZenML Pro has its own API.
20
20
2.**ZenML Pro API**: This is the management API for ZenML Pro and handles organization-level resources like workspaces, users, and roles.
21
21
22
22
### Server URL
@@ -113,20 +113,20 @@ See the high‑level overview: [Connect to a server](https://docs.zenml.io/how-t
113
113
114
114
## Workspace API Authentication
115
115
116
-
The **Workspace API** is different from the ZenML Pro API and supports different authentication methods. This is the API you'll use for triggering run templates and other pipeline operations.
116
+
The **Workspace API** is different from the ZenML Pro API and supports different authentication methods. This is the API you'll use for running snapshots and other pipeline operations.
117
117
118
118
### When to Use Which API
119
119
120
120
| Task | Use This API | Authentication Method |
121
121
|------|-------------|----------------------|
122
122
| Managing organizations, workspaces, users | **ZenML Pro API** (cloudapi.zenml.io) | Short-lived API tokens from organization settings |
123
123
| Accessing the ZenML Pro API programmatically from external systems | **ZenML Pro API** (cloudapi.zenml.io) | Service accounts + API keys (recommended for automation) |
124
-
| Triggering run templates, pipeline operations | **Workspace API** (your workspace URL) | Service accounts + API keys (recommended for automation) |
124
+
| Running snapshots, pipeline operations | **Workspace API** (your workspace URL) | Service accounts + API keys (recommended for automation) |
125
125
| Pipeline development, artifact management | **Workspace API** (your workspace URL) | Temporary API tokens or service accounts |
126
126
127
127
### Workspace API Authentication Methods
128
128
129
-
Programmatic access to the ZenML Pro workspace API is achieved mostly the same way as the ZenML OSS server API. This is because the Workspace API in ZenML Pro is an extension of the OSS API with some additional endpoints like Run Templates. The only exception is that workspace level service accounts and API keys are disabled and organization level service accounts and API keys are used instead (see [Service Accounts](https://docs.zenml.io/pro/core-concepts/service-accounts)).
129
+
Programmatic access to the ZenML Pro workspace API is achieved mostly the same way as the ZenML OSS server API. This is because the Workspace API in ZenML Pro is an extension of the OSS API with some additional endpoints. The only exception is that workspace level service accounts and API keys are disabled and organization level service accounts and API keys are used instead (see [Service Accounts](https://docs.zenml.io/pro/core-concepts/service-accounts)).
130
130
131
131
You can use one of these two methods to authenticate with your workspace API:
132
132
@@ -177,20 +177,19 @@ Remember to refer to the complete API documentation available at [https://clouda
177
177
178
178
The Workspace API includes all OSS API endpoints plus some additional Pro-specific endpoints. These are available at your workspace URL at the `/docs` path (e.g., https://1bfe8d94-zenml.cloudinfra.zenml.io/docs):
179
179
180
-
#### Run Templates (Pro-specific)
180
+
#### Running snapshots (Pro-specific)
181
181
182
-
Run Templates allow you to trigger pipeline runs from external systems using HTTP requests.
182
+
Snapshots allow you to start pipeline runs from external systems using HTTP requests.
183
183
184
-
* List run templates: `GET /run_templates`
185
-
* Create a run template: `POST /run_templates`
186
-
* Get run template details: `GET /run_templates/{template_id}`
187
-
* Update a run template: `PATCH /run_templates/{template_id}`
188
-
* **Trigger a run template: `POST /run_templates/{template_id}/runs`**
184
+
* List snapshots: `GET /pipeline_snapshots`
185
+
* Get snapshot details: `GET /pipeline_snapshots/<SNAPSHOT-ID>`
186
+
* Update a snapshot: `PATCH /pipeline_snapshots/<SNAPSHOT-ID>`
187
+
* **Run a snapshot: `POST /pipeline_snapshots/<SNAPSHOT-ID>/runs`**
189
188
190
189
{% hint style="success" %}
191
-
**For Run Template Automation**
190
+
**For Snapshot Automation**
192
191
193
-
When triggering run templates from external systems or CI/CD pipelines, we strongly recommend using **service accounts with API keys** rather than temporary tokens. Service accounts provide:
192
+
When running snapshots from external systems or CI/CD pipelines, we strongly recommend using **service accounts with API keys** rather than temporary tokens. Service accounts provide:
194
193
195
194
* Long-term credentials that don't expire hourly
196
195
* Dedicated authentication for automation (not tied to individual users)
@@ -217,7 +216,7 @@ Use this decision tree to determine the right approach:
217
216
218
217
|**What do you want to do?**|**Which API?**|**Authentication Method**|**Why?**|
|Trigger run templates from CI/CD or external systems |**Workspace API** (your workspace URL) | Service account + API key | Long-lived, automation-friendly, not tied to users |
219
+
|Run snapshots from CI/CD or external systems |**Workspace API** (your workspace URL) | Service account + API key | Long-lived, automation-friendly, not tied to users |
221
220
| Manage organizations, create workspaces, invite users |**ZenML Pro API** (cloudapi.zenml.io) | Short-lived API tokens from org settings | Administrative operations need user-level permissions |
222
221
| Access the ZenML Pro API programmatically from external systems |**ZenML Pro API** (cloudapi.zenml.io) | Service accounts + API keys (recommended for automation) | Long-lived, automation-friendly, not tied to users |
223
222
| Develop pipelines, explore artifacts |**Workspace API** (your workspace URL) | Temporary API tokens or service accounts | Flexible for development needs |
@@ -234,6 +233,6 @@ Use this decision tree to determine the right approach:
234
233
- ✅ Switch from temporary API tokens to service account API keys
235
234
- ✅ Service account tokens don't expire automatically like user tokens
236
235
237
-
**"I can't find the run template endpoints"**
238
-
- ✅ Run templates are only available on the **Workspace API**, not the ZenML Pro API
236
+
**"I can't find the endpoint to run a snapshot"**
237
+
- ✅ Running snapshots is only possible using the **Workspace API**, not the ZenML Pro API
239
238
- ✅ Use your workspace URL + `/docs` to see the full API documentation
Copy file name to clipboardExpand all lines: docs/book/getting-started/core-concepts.md
+4Lines changed: 4 additions & 0 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -146,6 +146,10 @@ ZenML comes with a _Docker deployer_ that can run deployments on your local mach
146
146
147
147
A **Pipeline Run** is a record of a pipeline execution. When you run a pipeline using an orchestrator, a pipeline run is created tracking information about the execution such as the status, the artifacts and metadata produced by the pipeline and all its steps. When a pipeline is deployed for online mode execution, a pipeline run is similarly created for every HTTP request made to it.
148
148
149
+
#### Pipeline Snapshot
150
+
151
+
A **Pipeline Snapshot** is an immutable snapshot of your pipeline that includes the pipeline DAG, code, configuration, and container images. Snapshots can be run from the server or dashboard, and can also be [deployed](#deployment).
152
+
149
153
#### Artifact Store
150
154
151
155
An **Artifact Store** is a component that houses all data that passes through the pipeline as inputs and outputs. Each artifact that gets stored in the artifact store is tracked and versioned and this allows for extremely useful features like data caching, which speeds up your workflows.
0 commit comments