|
1 | | -# Multi Comparison Matrix (MCM) |
| 1 | +# Multi-Comparison Matrix (MCM) |
2 | 2 |
|
3 | 3 | ### A Long Term Approach to Benchmark Evaluations |
4 | 4 |
|
@@ -27,20 +27,70 @@ In order for the user to plot the MCM, first thing is to load the ```.csv``` fil |
27 | 27 |
|
28 | 28 | ## Examples |
29 | 29 |
|
30 | | -Generating the MCM on the [following example](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/main/results_example.csv) produces the following. |
| 30 | +Generating the MCM on the [following example](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/main/results_example.csv) produces the following. To generate the following figure, the user follows this simple code: |
| 31 | + |
| 32 | +``` |
| 33 | +import pandas as pd |
| 34 | +from MCM import MCM |
| 35 | +
|
| 36 | +df_results = pd.read_csv('path/to/csv') |
| 37 | +
|
| 38 | +output_dir = '/output/directory/desired' |
| 39 | +
|
| 40 | +MCM.compare( |
| 41 | + output_dir=output_dir, |
| 42 | + df_results=df_results, |
| 43 | + fig_savename='heatmap', |
| 44 | + load_analysis=False |
| 45 | + ) |
| 46 | +``` |
31 | 47 |
|
32 | 48 | <p align="center" width="100%"> |
33 | 49 | <img src="heatmap.png" alt="heatmap-example"/> |
34 | 50 | </p> |
35 | 51 |
|
36 | 52 | Generating the MCM on the [following example](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/main/results_example.csv) by excluding ```clf1``` and ```clf3``` from the columns. |
37 | 53 |
|
| 54 | +``` |
| 55 | +import pandas as pd |
| 56 | +from MCM import MCM |
| 57 | +
|
| 58 | +df_results = pd.read_csv('path/to/csv') |
| 59 | +
|
| 60 | +output_dir = '/output/directory/desired' |
| 61 | +
|
| 62 | +MCM.compare( |
| 63 | + output_dir=output_dir, |
| 64 | + df_results=df_results, |
| 65 | + excluded_col_comparates=['clf1','clf3'], |
| 66 | + fig_savename='heatline_vertical', |
| 67 | + load_analysis=False |
| 68 | + ) |
| 69 | +``` |
| 70 | + |
38 | 71 | <p align="center" width="100%"> |
39 | 72 | <img src="heatline_vertical.png" alt="heatline-vertical-example"/> |
40 | 73 | </p> |
41 | 74 |
|
42 | 75 | and by excluding them in the rows. |
43 | 76 |
|
| 77 | +``` |
| 78 | +import pandas as pd |
| 79 | +from MCM import MCM |
| 80 | +
|
| 81 | +df_results = pd.read_csv('path/to/csv') |
| 82 | +
|
| 83 | +output_dir = '/output/directory/desired' |
| 84 | +
|
| 85 | +MCM.compare( |
| 86 | + output_dir=output_dir, |
| 87 | + df_results=df_results, |
| 88 | + excluded_row_comparates=['clf1','clf3'], |
| 89 | + fig_savename='heatline_vertical', |
| 90 | + load_analysis=False |
| 91 | + ) |
| 92 | +``` |
| 93 | + |
44 | 94 | <p align="center" width="100%"> |
45 | 95 | <img src="heatline_horizontal.png" alt="heatline-horizontal-example"/> |
46 | 96 | </p> |
|
0 commit comments