Skip to content

Commit 261a7b7

Browse files
committed
Permutation Plot: Docs
1 parent 544ee8c commit 261a7b7

File tree

6 files changed

+39
-6
lines changed

6 files changed

+39
-6
lines changed

Orange/widgets/evaluate/icons/PermutationPlot.svg

Lines changed: 6 additions & 6 deletions
Loading

doc/visual-programming/source/index.rst

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -132,6 +132,7 @@ Evaluate
132132
widgets/evaluate/predictions
133133
widgets/evaluate/rocanalysis
134134
widgets/evaluate/testandscore
135+
widgets/evaluate/permutationplot
135136

136137

137138
.. toctree::
45.7 KB
Loading
20.8 KB
Loading
Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,25 @@
1+
Permutation Plot
2+
================
3+
4+
Check the validity and the degree of overfit for the input learner.
5+
6+
**Inputs**
7+
8+
- Data: input dataset
9+
- Learner: learning algorithm
10+
11+
![](images/Permutation-Plot-stamped.png)
12+
13+
1. Select the number of permutation. The target variable is randomly permuted and separate learners are fitted to all the permuted y-variables.
14+
2. Information on the model performance.
15+
3. Get help, save the plot, make the report, set plot properties.
16+
4. Observe the size and type of inputs.
17+
18+
The Permutation plot displays the correlation coefficient between the original y-variable and the permuted y-variable on the x-axis versus the cumulative R2/AUC on the y-axis, and draws a regression line. The intercept is a measure of the overfit.
19+
20+
Examples
21+
--------
22+
23+
Here is a example on the housing data, where we analyze the performance of a [Random Forest](../model/randomforest.md) model.
24+
25+
![](images/Permutation-Plot-example.png)

doc/widgets.json

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -858,6 +858,13 @@
858858
"calibration",
859859
"plot"
860860
]
861+
},
862+
{
863+
"text": "Permutation Plot",
864+
"doc": "visual-programming/source/widgets/evaluate/permutationplot.md",
865+
"icon": "../Orange/widgets/evaluate/icons/PermutationPlot.svg",
866+
"background": "#C3F3F3",
867+
"keywords": []
861868
}
862869
]
863870
],

0 commit comments

Comments
 (0)