You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: md-docs/user_guide/data.md
+30-4Lines changed: 30 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -130,7 +130,7 @@ On the other hand, in RAG tasks there is no target or training dataset.
130
130
131
131
The [Monitoring] module requires the definition of a Reference dataset representing training, validation and test data.
132
132
As mentioned before, historical data belong to both training and old data, but it is important distinguish them.
133
-
Therefore, the reference data is initially loaded as historical data and then marked as reference data by providing the timestamp interval.
133
+
Therefore, the reference data is initially loaded as historical data and then marked as reference data by providing the timestamp interval. This interval is defined as one or more [from timestamp, to timestamp] tuples. It serves also as default interval being applied to any [Segment] without a specific time range. Optionally, segment-specific intervals can be provided, also as lists of [from timestamp, to timestamp] tuples.
134
134
135
135
To provide sufficient statistical reliability, reference data must include at least 300 samples. This requirement also applies to the reference of each [Segment], if the task involves any.
136
136
@@ -142,16 +142,42 @@ For RAG Tasks, reference data can be used to indicate the type of data expected
142
142
143
143
??? code-block "SDK Example"
144
144
145
-
You can set reference data as follow:
145
+
You can set the default reference data as follow:
146
146
147
147
``` py
148
148
job_id = client.set_model_reference(
149
149
model_id=model_id,
150
-
from_timestamp=from_timestamp,
151
-
to_timestamp=to_timestamp,
150
+
default_reference=ReferenceInfo(
151
+
time_intervals=[(from_timestamp, to_timestamp)]
152
+
),
152
153
)
153
154
```
154
155
156
+
In case you want to set multiple default intervals:
0 commit comments