You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The `run` method returns a dictionary containing the statistical information of the categories.
63
+
| Field | Type | Description |
64
+
| :-------------- | :---- | :---------- |
65
+
| key | str | Primary category name. |
66
+
| value | dict | Dictionary containing the total number of samples for this primary category (`primary_num`) and the number of samples for each secondary category. |
37
67
38
-
**Example Input Data in DataFrame:**
68
+
Example input (dataframe rows stored in `storage`):
The `run` function returns a dictionary containing the statistics of the difficulty distribution. The keys of the dictionary are the unique difficulty levels found in the dataset, and the values are the counts of samples for each level.
63
+
#### 🧾 Return Value
41
64
42
-
**Example Input (Data in `storage`)**:
43
-
A dataframe with a column named `difficulty_score` (or as specified by `input_diffulty_key`).
This operator returns a dictionary where the keys are the difficulty levels found in the dataset, and the values are the corresponding sample counts for each difficulty level.
53
66
54
-
**Example Output (Return value of `run` function)**:
| Prompt Template Name | Main Purpose | Applicable Scenarios | Feature Description |
24
24
| :--- | :--- | :--- | :--- |
25
-
|||||
25
+
|MathQuestionCategoryPrompt | Multi-level question classification | Classifying user questions into primary and secondary categories | Takes input questions and outputs primary and secondary classifications|
The `ReasoningQuestionDifficultySampleEvaluator` is an operator designed to evaluate the difficulty level of questions. It leverages a Large Language Model (LLM) to analyze the complexity of a given question and outputs a numerical difficulty score, typically on a scale of 1 to 10.
is a question difficulty evaluation operator. It analyzes the complexity of questions by calling a Large Language Model (LLM) and generates a difficulty score from 1 to 10 for each question.
| MathQuestionDifficultyPrompt | Question difficulty evaluation | Evaluating the difficulty of user questions | Input question, output difficulty score from 1 to 10 |
0 commit comments