You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This page outlines key principles and best practices to help you ensure your applications' security and reliability when using Generative APIs.
14
15
15
16
## Resilience
16
17
17
-
Resilience ensures the continuity and availability of your applications and data, even in the face of disruptions or failures. In Generative APIs, you can promote resilience through the following pillars: availability, durability and performance.
18
+
Resilience ensures the continuity and availability of your applications and data, even in the face of disruptions or failures. In Generative APIs, you can promote resilience through three pillars: **availability**, **durability** and **performance**.
Monitoring is an essential pillar to ensure the security and reliability of your services. The practice provides real-time insights into the performance, security, and resource consumption of your usage of Generative APIs.
49
+
Monitoring is an essential pillar to ensure the security and reliability of your services. It provides real-time insights into the performance, security, and resource consumption of your Generative APIs usage.
49
50
50
51
### Metrics and logs
51
52
52
-
Generative APIs metrics and logs are stored inside [Cockpit](/cockpit/).
53
+
Generative APIs metrics and logs are stored inside [Scaleway Cockpit](/cockpit/).
53
54
54
55
This includes:
55
56
-**Metrics**: Input and output tokens and API requests. Metrics are refreshed every minute (some dashboards may aggregate data by the hour for accuracy reasons, but metrics can be queried at a finer rate using Cockpit custom dashboards)
@@ -80,47 +81,47 @@ Two types of API version updates may be performed:
80
81
| Minor | These updates do not change the API's current fields format and are backward compatible (no action is required on your side). New fields and features can however be added. |
81
82
| Major | These updates change the API's current fields or paths. They may require action from your side. In this case, we will notify you with at least 3 months' warning before deprecating significant features that might break your application. |
82
83
83
-
#### Third party tools compatibility
84
+
#### Compatibility with third party tools
84
85
85
-
By following industry standards (such as targeting OpenAI API compatibility), we aim to provide compatibility with most AI ecosystems and tools by default. However, as ecosystems evolve quickly, we cannot guarantee compatibility with third party tools, but provide extensive documentation:
86
-
- Current API supported features are available in our API Documentation
87
-
- Advanced errors and edge cases workarounds in our [Troubleshooting section](/generative-apis/troubleshooting/fixing-common-issues/).
88
-
-Integration with third party tools is available in our [dedicated documentation page](/generative-apis/reference-content/integrating-generative-apis-with-popular-tools/#openai-client-libraries)
86
+
By following industry standards (such as targeting OpenAI API compatibility), we aim to provide compatibility with most AI ecosystems and tools by default. However, as ecosystems evolve quickly, we cannot always guarantee compatibility with third party tools. We do provide extensive documentation:
87
+
- Current API supported features are available in our [API Documentation](/generative-apis/api-cli/)
88
+
- Advanced errors and edge case workarounds are provided in our [Troubleshooting section](/generative-apis/troubleshooting/fixing-common-issues/).
89
+
-Information about integration with third party tools is available in our [dedicated documentation page](/generative-apis/reference-content/integrating-generative-apis-with-popular-tools/#openai-client-libraries)
89
90
90
91
## Data protection
91
92
92
-
Our data protection measures are detailed in our [privacy policy page](/generative-apis/reference-content/data-privacy/).
93
+
Our data protection measures are detailed on our [privacy policy page](/generative-apis/reference-content/data-privacy/).
93
94
94
95
- Scaleway does not store sensitive data (such as the content of your prompt), unless we need it to provide the service (such as when using batch processing)
95
96
- When data is stored, it is protected using a state of the art method (such as encryption at rest)
96
-
- During transit, your data is encrypted by relying on the HTTPS protocol
97
+
- During transit, your data is encrypted via the HTTPS protocol
97
98
98
99
### Scaleway access
99
100
100
101
In order to perform maintenance operations and guarantee the reliability of Generative APIs, or comply with local regulations, we need to access servers hosting the Generative APIs service.
101
102
102
-
Most of the time, they are automatic actions, when Scaleway needs to update configuration or upgrade software versions, for example.
103
+
Most of the time, any actions Scaleway carries out are automatic, e.g. updating configuration or upgrading software versions.
103
104
104
-
Manual interventions might be required occasionally, and for troubleshooting reasons (such as specific customer requests generating errors or performing malicious activity), we may temporarily complete the content of HTTP requests to identify a root cause issue or any security vulnerability. All Scaleway accesses are authenticated and traced following industry security standards.
105
+
Manual interventions might be required occasionallyfor troubleshooting reasons (such as specific customer requests generating errors or carrying out malicious activity). We may temporarily complete the content of HTTP requests to identify a root cause issue or any security vulnerability. All Scaleway access is authenticated and traced following industry security standards.
105
106
106
107
## Identity and access management
107
108
108
109
Identity and access management allows you to enable granular control over user permissions and to mitigate the risk of unauthorized access or data breaches.
109
110
110
-
All accesses to Generative APIs are authenticated and authorized relying on [Scaleway IAM permissions sets](/iam/reference-content/permission-sets/).
111
+
All access to Generative APIs is authenticated and authorized, relying on [Scaleway IAM permissions sets](/iam/reference-content/permission-sets/).
111
112
112
-
You are responsible for attributing these permissions to the relevant users or applications and reviewing these accesses frequently.
113
+
You are responsible for attributing these permissions to the relevant users or applications, and for reviewing these accesses frequently.
113
114
114
115
## Compliance
115
116
116
-
Several regulations apply to us directly, whereas others apply to your usage. Even in this case, we help you ease your compliance process by providing you with the information you need from your cloud provider.
117
+
Several regulations apply to us (Scaleway) directly, whereas others apply to your usage. Even in this case, we help you ease your compliance process by providing you with the information you need from your cloud provider.
117
118
### AI Act
118
119
119
120
We (Scaleway) ensure our compliance with the AI Act within our scope of responsibilities. We also ensure that you have the information needed to comply with the requirements that apply to you. This means concretely:
120
-
- Gathering AI Model Providers information about their models (such as whether their training capacity is above 10²⁵ FLOPs, and falls into a specific category) and provide you with a link to these documents when they are made available by AI Model Providers.
121
+
- Gathering information from AI Model Providers about their models (such as whether their training capacity is above 10²⁵ FLOPs, and falls into a specific category), and providing you with a link to these documents when they are made available.
121
122
- Providing you with links towards licensing required by the AI Model Providers.
122
123
123
-
Scaleway has no access to, nor knowledge of any inputs and outputs generated by the models. By using our AI products, you agree and acknowledge that you are (i) responsible for this use including any content integrated into the models, and (ii) required to use the AI products in compliance with our General Terms of services.
124
+
Scaleway has no access to, nor knowledge of any inputs and outputs generated by the models. By using our AI products, you agree and acknowledge that you are (a) responsible for this use, including any content integrated into the models, and (b) required to use the AI products in compliance with our General Terms of Services.
124
125
125
126
As a client of our AI products, you are likely to be considered an AI System Provider or Deployer under the AI Act. As such, it is your responsibility to ensure you comply with requirements that apply to you.
0 commit comments