You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: md-docs/user_guide/integrations/retrain_trigger.md
+25-11Lines changed: 25 additions & 11 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -1,8 +1,11 @@
1
-
This section offers an overview of setting up retrain triggers for your models. These triggers enable the automatic initiation of your retraining pipeline from the ML cube Platform.
1
+
# Retrain Trigger
2
2
3
-
A retrain trigger can be utilized within a Detection Event Rule. When specific criteria are met, it automatically generates the retrain report and activates the trigger. Alternatively, you can manually activate the trigger for the model on the retraining tool page.
3
+
This section offers an overview of how you can set up a retrain trigger for your model.
4
+
Retrain triggers enable the automatic initiation of your retraining pipeline from the ML cube Platform. They are designed as
5
+
integrations with external services and thus require credentials with the appropriate privileges to be executed.
4
6
5
-
A retrain trigger is designed as an integration with an external service and necessitates credentials with the appropriate privileges to execute the action.
7
+
A Retrain Trigger can be utilized within a [Detection Event Rule](../monitoring/detection_event_rules.md). Alternatively,
8
+
it can be manually activated from the WebApp, in the Retraining section.
6
9
7
10
## Supported Triggers
8
11
@@ -94,11 +97,15 @@ The following retrain triggers are supported:
94
97
95
98
**Retrain Trigger Setup**
96
99
97
-
To integrate Amazon Event Bridge, you will need to create a set of AWS credentials, and add a policy that allows to put events in your event bus. Please refer to [this page](index.md) to know more.
100
+
To integrate Amazon Event Bridge, you need to create a set of AWS credentials, and add a policy that allows to put events in
101
+
your event bus. Please refer to [this page](index.md) for more information.
98
102
99
-
Once the credentials and the policy have been created, you can set up the retrain trigger for your model through the SDK or the web application.
103
+
Once the credentials and the policy have been created, you can set up the retrain trigger for your model through the SDK
104
+
or the web application.
100
105
101
-
!!! example
106
+
??? code-block "SDK Example"
107
+
108
+
Here is an example of how to set up an AWS Event Bridge Retrain Trigger using the SDK:
102
109
103
110
```py
104
111
client.set_retrain_trigger(
@@ -147,11 +154,15 @@ The following retrain triggers are supported:
147
154
148
155
**Retrain Trigger Setup**
149
156
150
-
To integrate GCP Pub/Sub, you will need to create a set of GCP credentials, and add a policy that allows to put events in your Pub/Sub topic. Please refer to [this page](index.md) to know more.
157
+
To integrate GCP Pub/Sub, you need to create a set of GCP credentials, and add a policy that allows to put events
158
+
in your Pub/Sub topic. Please refer to [this page](index.md) for more information.
151
159
152
-
Once the credentials and the policy have been created, you can set up the retrain trigger for your model through the SDK or the web application.
160
+
Once the credentials and the policy have been created, you can set up the retrain trigger for your model through the SDK or
161
+
the web application.
153
162
154
-
!!! example
163
+
??? code-block "SDK Example"
164
+
165
+
Here is an example of how to set up a GCP Pub/Sub Retrain Trigger using the SDK:
155
166
156
167
```py
157
168
client.set_retrain_trigger(
@@ -198,11 +209,14 @@ The following retrain triggers are supported:
198
209
199
210
**Retrain Trigger Setup**
200
211
201
-
To integrate Azure Event Grid, you will need to create a set of Azure credentials, and add a role that allows to publish events in your Event Grid topic. Please refer to [this page](index.md) to know more.
212
+
To integrate Azure Event Grid, you need to create a set of Azure credentials, and add a role that allows to publish events in your Event Grid topic.
213
+
Please refer to [this page](index.md) for more information.
202
214
203
215
Once the credentials and the policy have been created, you can set up the retrain trigger for your model through the SDK or the web application.
204
216
205
-
!!! example
217
+
??? code-block "SDK Example"
218
+
219
+
Here is an example of how to set up an Azure Event Grid Retrain Trigger using the SDK:
| Average Precision | For Object Detection tasks |
52
57
53
58
RAG tasks have no metric, as in that case the model is an LLM for which classic definitions of metrics are not applicable.
54
59
60
+
!!! warning
61
+
Model Metrics should not be confused with [Monitoring Metrics](monitoring/index.md#monitoring-metrics), which are
62
+
entities being monitoring by the ML cube Platform and not necessarily related to a Model.
63
+
55
64
### Suggestion Type
56
65
57
66
The Suggestion Type represents the type of suggestion that the ML cube Platform should provide when computing the
58
-
[retraining dataset](modules/retraining.md#retraining-dataset). The available options are:
67
+
[Retraining Dataset](modules/retraining.md#retraining-dataset). The available options are provided in the related section.
59
68
60
-
-`Sample Weights`: each sample uploaded in ML cube Platform is assigned a weight that can be used as sample weight in a weighted loss function.
61
-
The higher the weight, the greater the importance of the sample for the new retraining.
62
-
-`Resampled Dataset`: a list of sample ids (using data schema column object with role ID) is provided indicating which data form the retraining dataset.
63
-
This format can be used when the training procedure does not support weighted loss or when a fixed size retraining dataset is preferred.
64
-
Note that samples ids can appear more than once: this happens when a sample is particularly important for the new retraining.
65
69
66
-
[Task]: task.md
67
-
[Data Schema]: data_schema.md
70
+
### Retraining Cost
68
71
69
-
[//]: #()
70
-
[//]: #()
71
-
[//]: #(What is additional probabilistic output?)
72
+
The Retraining Cost represents the cost associated with retraining the model. This information is used by the Retraining Module
73
+
to provide gain-cost analysis and insights on the retraining process. The cost is expressed in the same currency as the one used
74
+
in the Task cost information. The default value is 0.0, which means that the cost is negligible.
72
75
73
-
[//]: #()
74
-
[//]: #(What is metric?)
76
+
### Retrain Trigger
75
77
76
-
[//]: #()
77
-
[//]: #(What is suggestion type?)
78
+
You can associate a [Retrain Trigger] to your Model in order to enable the automatic initiation of your retraining pipeline
79
+
from the ML cube Platform. More information on how to set up a retrain trigger can be found in the related section.
0 commit comments