Skip to content

Commit b0fb4b5

Browse files
raethloTC-MOdanpoletaevtobice
authored
feat: General Resource Access (#1894)
This PR adds documentation for General Resource Access, new account and resource level setting that enables to fine tune resource access when using resource ids or links. --------- Co-authored-by: Michał Olender <[email protected]> Co-authored-by: Daniil Poletaev <[email protected]> Co-authored-by: Tobiáš Potoček <[email protected]>
1 parent 56bf9c2 commit b0fb4b5

File tree

10 files changed

+219
-2
lines changed

10 files changed

+219
-2
lines changed
Lines changed: 174 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,174 @@
1+
---
2+
title: General resource access
3+
description: Control how Apify resources are shared. Set default access (Anyone with ID can read or Restricted), and learn about link sharing, exceptions, and pre-signed URLs.
4+
sidebar_position: 1
5+
category: platform
6+
slug: /collaboration/general-resource-access
7+
---
8+
9+
Some resources, like storages, Actor runs or Actor builds, can be shared simply by sending their unique resource ID or Console link and the recipient can then view the data in Console or fetch it via API without needing an API token. This is very useful for ad-hoc collaboration, integrating third party tools that connect to data in your Apify account or quick prototypes.
10+
11+
Thanks to the hard-to-guess, unique IDs, it’s also secure enough for most use cases. However, it doesn't offer features like access revocation and in some cases, you may want to have more direct control over data access and require users to have explicit permissions to your resources.
12+
13+
**General resource access** is an account setting that defines the default access policy at the account level. You can find General resource access in Apify Console under **Settings → Security & Privacy**. The two following options are supported:
14+
15+
- **Anyone with ID can read (default)**: Selected resources can be accessed using just their unique resource ID. This means if you share the resource ID with someone, they would be able to view it without providing an API token or viewing the resource by visiting the Console URL.
16+
- **Restricted**: With this setting, only signed-in users with an explicit access to the resources can access them. To access restricted resources via API, a valid token needs to be provided.
17+
18+
This setting affects the following resources:
19+
20+
- Actor runs
21+
- Actor builds
22+
- Storages:
23+
- Datasets
24+
- Key-value stores
25+
- Request queues
26+
27+
Access to resources that require explicit access — such as Actors, tasks or schedules are not affected by this setting.
28+
29+
![Setup account-level general resources access setting](./images/general-resouce-access//account-setting.png)
30+
31+
## How Restricted Access works
32+
33+
If your **General resource access** is set to **Anyone with ID can read**, you can just send this link to anybody, and they will be able to download the data even if they don’t have an Apify account. However, once you change the setting to **Restricted**, this API call will require a valid token with access in order to work. In other words, you’ll have to explicitly share the dataset and you can only do that with people who have an Apify account.
34+
35+
:::tip Access Setting Changes May Be Delayed
36+
When you change the access for a resource it may take a minute for the change to take effect.
37+
:::
38+
39+
### What is the best setting for me
40+
41+
Sharing by link is quick, convenient, and secure enough for most use cases -- thanks to the use of hard-to-guess unique IDs.
42+
43+
That said, link-based sharing doesn’t support access revocation, audit trails, or fine-grained permission controls. If you need tighter control over who can access your data or require elevated security because of the domain you're working in we recommend enabling **Restricted** access.
44+
45+
The default setting strikes a good balance for casual or internal use, but **Restricted** access is a better fit for teams with stricter security policies, integrations using scoped API tokens, or audit requirements.
46+
47+
You can switch to **Restricted** access at any time. If it causes issues in your workflow, you can revert to the default setting just as easily.
48+
49+
:::note Support in public Actors
50+
Because this is a new setting, some existing public Actors and integrations might not support it yet. Their authors need to update them to provide a valid token on all API calls.
51+
:::
52+
53+
54+
### Exceptions
55+
56+
Even if your access is set to **Restricted** there are a few built-in exceptions that make collaboration and platform features work seamlessly. These are explained in the sections below.
57+
58+
59+
#### Builds of public Actors
60+
61+
Builds of public Actors are always accessible to anyone who can view the Actor — regardless of the Actor owner’s account **General resource access** setting.
62+
63+
This ensures that public Actors in the Apify Store continue to work as expected. For example, if you open a public Actor in Console, you’ll also be able to view its build details, download logs, or inspect the source package — without needing extra permissions or a token.
64+
65+
This exception exists to maintain usability and avoid breaking workflows that rely on public Actors. It only applies to builds of Actors that are marked as **public**. For private Actors, build access still follows the general resource access setting of the owner’s account.
66+
67+
#### Automatically share owner runs of shared Actors & Tasks with collaborators
68+
69+
When you share an Actor with a collaborator, you can choose to share read-only access to your (the owner’s) runs of that Actor. This makes it easier for them to help with debugging, monitoring, or reviewing outputs.
70+
71+
- This access includes logs, input, and default storages (dataset, key-value store, request queue)
72+
- Access is one-way: you won’t see the collaborator’s runs unless they share them
73+
- Collaborators can’t see each other’s runs
74+
- This works even if your account uses **restricted general resource access** — permissions are applied automatically.
75+
76+
#### Automatically sharing runs with public Actor creators
77+
78+
If you’re using a public Actor from the Apify Store, you can choose to automatically share your runs of that Actor with its creator. This helps developers monitor usage and troubleshoot issues more effectively.
79+
80+
- This setting is opt-in and can be enabled under **Account Settings → Privacy**
81+
- When enabled, your runs of public Actors are automatically visible to the Actor’s creator
82+
- Shared runs include logs, input, and output storages (dataset, key-value store, request queue)
83+
84+
This sharing works even if your account has **General resource access** set to **Restricted** — the platform applies specific permission checks to ensure the Actor creator can access only the relevant runs.
85+
86+
You can disable this behavior at any time by turning off the setting in your account.
87+
88+
#### Automatically sharing runs via Actor Issues
89+
90+
When you report an issue on an Actor and include a **run URL**, that run is automatically shared with the Actor developer — **even if your account uses restricted general resource access**.
91+
92+
This automatic sharing ensures the developer can view all the context they need to troubleshoot the issue effectively. That includes:
93+
94+
- Full access to the run itself (logs, input, status)
95+
- Automatic access to the run’s default storages:
96+
- Dataset
97+
- Key-value store
98+
- Request queue
99+
100+
The access is granted through explicit, behind-the-scenes permissions (not anonymous or public access), and is limited to just that run and its related storages. No other resources in your account are affected.
101+
102+
This means you don’t need to manually adjust permissions or share multiple links when reporting an Actor issue — **just including the run URL in your issue is enough**
103+
104+
![Sharing a run link in create Actor issue dialog makes it accessible to the developer automatically](./images/general-resouce-access/creating-actor-issue.png)
105+
106+
## Per-resource access control
107+
108+
The account level access control can be changed on individual resources. This can be done by setting the general access level to other than Restricted in the share dialog for a given resource. This way the resource level setting takes precedence over the account setting.
109+
110+
![Setup resource level access control](./images/general-resouce-access/share-resource-dialog.png)
111+
112+
:::tip Using Apify API
113+
You can also set the general access on a resource programmatically using the Apify API or Apify client. Read more in the API reference and client documentation.
114+
115+
```js
116+
const datasetClient = apifyClient.dataset(datasetId);
117+
await datasetClient.update({
118+
generalAccess: STORAGE_GENERAL_ACCESS.ANYONE_WITH_ID_CAN_READ
119+
});
120+
```
121+
122+
:::
123+
124+
### Sharing restricted resources with pre-signed URLs {#pre-signed-urls}
125+
126+
Even when a resource is restricted, you might still want to share it with someone outside your team — for example, to send a PDF report to a client, or include a screenshot in an automated email or Slack message. In these cases, **storage resources** (like key-value stores, datasets, and request queues) support generating **pre-signed URLs**. These are secure, time-limited links that let others access individual files without needing an Apify account or authentication.
127+
128+
Pre-signed URLs:
129+
130+
- Work even when General resource access is restricted
131+
- Expire automatically after 14 days (by default)
132+
- Are scoped to a single resource (prevents access to other records)
133+
- Are ideal for sharing screenshots, reports, or any other one-off files
134+
135+
To generate a pre-signed link, you can use the **Export** button in Console, or call the appropriate API client method.
136+
137+
![Generating shareable link for a restricted storage resource](./images/general-resouce-access/copy-shareable-link.png)
138+
139+
:::info Console links for resources
140+
141+
Resource objects returned by the API and clients (like `apify-client-js`) include a `consoleUrl` property. This provides a stable link to the resource's page in the Apify Console. Unlike a direct API link, Console link will prompt unauthenticated users to sign in, ensuring they have required permissions to view the resource.
142+
143+
This is ideal for use-cases like email notifications or other automated workflows.
144+
145+
:::
146+
147+
### Sharing storages by name
148+
149+
A convenient feature of storages is that you can name them. If you choose to do so there is an extra access level setting that applies to storages only, which is **Anyone with name or ID can read**. In that case anyone that knows the storage name is able to read it via API or view it using the storages Console URL.
150+
151+
:::tip Exposing public named datasets
152+
153+
This is very useful if you wish to expose a storage publicly with an easy to remember URL.
154+
155+
:::
156+
157+
## Implications for public Actor developers
158+
159+
If you own a public Actor in the Apify Store, you need to make sure that your Actor will work even for users who have restricted access to their resources. Over time, you might see a growing number of users with **General resource access** set to **Restricted**.
160+
161+
:::tip Testing public access behavior
162+
163+
To test your public Actor, run it using an account with **General resource access** set to restricted. You can use your developer account, or create a temporary testing Apify account.
164+
165+
:::
166+
167+
In practice, this means that all API calls originating from the Actor need to have a valid API token. If you are using Apify SDK, this should be the default behavior.
168+
169+
170+
:::caution Actor Runs Inherit User Permissions
171+
172+
Keep in mind that when users run your public Actor, the Actor makes API calls under the user account, not your developer account. This means that it follows the **General resource access** configuration of the user account. The configuration of your developer account has no effect on the Actor users.
173+
174+
:::
86.6 KB
Loading
262 KB
Loading
156 KB
Loading
210 KB
Loading

sources/platform/collaboration/index.md

Lines changed: 15 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -9,14 +9,28 @@ slug: /collaboration
99
**Learn how to collaborate with other users and manage permissions for organizations or private resources such as Actors, Actor runs, and storages.**
1010

1111
---
12+
Apify was built from the ground up as a collaborative platform. Whether you’re publishing your Actor in Apify Store or sharing a dataset with a teammate, collaboration is deeply integrated into how Apify works. You can share your resources (like Actors, runs, or storages) with others, manage permissions, or invite collaborators to your organization. By default, each system resource you create is only available to you, the owner. However, you can grant access to other users, making it easy to collaborate effectively and securely.
1213

13-
By default, each system resource (Actor, key-value store, run, ...) you create is only available to you, the owner. You can grant access to your resources in three ways:
14+
While most resources can be shared by assigning permissions (see [Access Rights](./access_rights.md)), some resources can also be shared simply by using their unique links or IDs. There are two types of resources in terms of sharing:
15+
16+
- _Resources that require explicit access by default:_
17+
- [Actors](../actors/running/index.md), [tasks](../actors/running/tasks.md)
18+
- Can be shared only by inviting collaborators using [Access Rights](./access_rights.md)) or using [Organization Accounts](./organization_account/index.md)
19+
- _Resources supporting both explicit access and link sharing:_
20+
- Actor runs, Actor builds and storage resources (datasets, key-value stores, request queues)
21+
- Can be shared by inviting collaborators or simply by sharing a unique direct link
22+
23+
You can control access to your resources in four ways:
1424

1525
<table>
1626
<tr>
1727
<td><strong><a href="/platform/collaboration/access-rights">Access rights</a></strong></td>
1828
<td>Enables you to grant access to another user for a certain resource you own. This way, you can share results with your client, or two engineers can collaborate on developing one Actor.</td>
1929
</tr>
30+
<tr>
31+
<td><strong><a href="/platform/collaboration/general-resource-access">Share resources by link</a></strong></td>
32+
<td>Certain resources (runs, builds and storages) can by shared just by their link. Anyone with their ID is able to access them. This is configurable via <a href="/platform/collaboration/general-resource-access">General resource access</a></td>
33+
</tr>
2034
<tr>
2135
<td><strong><a href="/platform/collaboration/organization-account">Organization account</a></strong></td>
2236
<td>Apify's organization account allows multiple engineers to collaborate on team projects with role-specific access permissions.</td>

sources/platform/storage/dataset.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -382,6 +382,10 @@ By default, the whole result is wrapped in an `<items/>` element, while each pag
382382

383383
You can grant [access rights](../collaboration/index.md) to your dataset through the **Share** button under the **Actions** menu. For more details, check the [full list of permissions](../collaboration/list_of_permissions.md).
384384

385+
You can also share datasets by link using their ID or name, depending on your account or resource-level general access setting. Learn how link-based access works in [General resource access](/platform/collaboration/general-resource-access).
386+
387+
For one-off sharing of specific records when access is restricted, you can generate time-limited pre-signed URLs. See [Sharing restricted resources with pre-signed URLs](/platform/collaboration/general-resource-access#pre-signed-urls).
388+
385389
### Sharing datasets between runs
386390

387391
You can access a dataset from any [Actor](../actors/index.mdx) or [task](../actors/running/tasks.md) run as long as you know its _name_ or _ID_.

sources/platform/storage/key_value_store.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -256,6 +256,10 @@ _Using the [JavaScript SDK](/sdk/js/reference/class/KeyValueStore#setValue) or o
256256

257257
You can grant [access rights](../collaboration/index.md) to your key-value store through the **Share** button under the **Actions** menu. For more details check the [full list of permissions](../collaboration/list_of_permissions.md).
258258

259+
You can also share key-value stores by link using their ID or name, depending on your account or resource-level general access setting. Learn how link-based access works in [General resource access](/platform/collaboration/general-resource-access).
260+
261+
For one-off sharing of specific records when access is restricted, you can generate time-limited pre-signed URLs. See [Sharing restricted resources with pre-signed URLs](/platform/collaboration/general-resource-access#pre-signed-urls).
262+
259263
### Sharing key-value stores between runs
260264

261265
You can access a key-value store from any [Actor](../actors/index.mdx) or [task](../actors/running/tasks.md) run as long as you know its _name_ or _ID_.

sources/platform/storage/request_queue.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -558,6 +558,10 @@ A detailed tutorial on how to process one request queue with multiple Actor runs
558558
559559
You can grant [access rights](../collaboration/index.md) to your request queue through the **Share** button under the **Actions** menu. For more details check the [full list of permissions](../collaboration/list_of_permissions.md).
560560
561+
You can also share request queues by link using their ID or name, depending on your account or resource-level general access setting. Learn how link-based access works in [General resource access](/platform/collaboration/general-resource-access).
562+
563+
For one-off sharing of specific records when access is restricted, you can generate time-limited pre-signed URLs. See [Sharing restricted resources with pre-signed URLs](/platform/collaboration/general-resource-access#pre-signed-urls).
564+
561565
### Sharing request queues between runs
562566
563567
You can access a request queue from any [Actor](../actors/index.mdx) or [task](../actors/running/tasks.md) run as long as you know its _name_ or _ID_.

sources/platform/storage/usage.md

Lines changed: 18 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -160,7 +160,17 @@ For example, storage names `janedoe~my-storage-1` and `janedoe~web-scrape-result
160160

161161
## Sharing
162162

163-
You can grant [access rights](../collaboration/index.md) to others Apify users to view or modify your storages. Check the [full list of permissions](../collaboration/list_of_permissions.md).
163+
You can grant [access rights](../collaboration/index.md) to other Apify users to view or modify your storages. Check the [full list of permissions](../collaboration/list_of_permissions.md).
164+
165+
You can also share storages by link using their ID or name, depending on your account or resource-level general access setting. Learn how link-based access works in [General resource access](/platform/collaboration/general-resource-access).
166+
167+
For one-off sharing when access is restricted, generate time-limited pre-signed URLs. See [Sharing restricted resources with pre-signed URLs](/platform/collaboration/general-resource-access#pre-signed-urls).
168+
169+
:::tip Accessing restricted storage resources via API
170+
171+
If your storage resource is set to _restricted_, all API calls must include a valid authentication token in the `Authorization` header. If you're using **apify-client** the header is passed in automatically.
172+
173+
:::
164174

165175
### Sharing storages between runs
166176

@@ -173,6 +183,13 @@ Storage can be accessed from any [Actor](../actors/index.mdx) or [task](../actor
173183
> When multiple runs try to write data to a storage simultaneously, the order of data writing cannot be controlled. Data is written as each request is processed. <br/>
174184
> Similar principle applies in key-value stores and request queues, when a delete request for a record precedes a read request for the same record, the read request will fail.
175185
186+
:::info Accessing restricted storage resources between runs
187+
188+
If a storage resource access is set to **Restricted**,the run from which it's accessed must have explicit access to it.
189+
Learn how restricted access works in [General resource access](/platform/collaboration/general-resource-access).
190+
191+
:::
192+
176193
## Deleting storages
177194

178195
Named storages are only removed upon your request.<br/>

0 commit comments

Comments
 (0)