Skip to content

Commit a774e96

Browse files
committed
[DOC] updated readme
1 parent 820b4e1 commit a774e96

File tree

1 file changed

+9
-18
lines changed

1 file changed

+9
-18
lines changed

README.md

Lines changed: 9 additions & 18 deletions
Original file line numberDiff line numberDiff line change
@@ -6,10 +6,7 @@ This work is done by ```list_of_authors```.
66

77
## Summary
88

9-
This repo is a long term used benchmark method that generates either:
10-
11-
1. A HeatMap for a full 1v1 and multi comparison between classifiers evaluated on multiple dataset.
12-
2. A HeatLine for a 1v1 and multi comparison between a proposed method VS other approaches.
9+
This repo is a long term used benchmark method that generates a Multi-Comparison Matrix where the user ca choose whether to include a full pairwise multi-comparate comparison or to choose which ones to be included or excluded in the rows and columns of the matrix.
1310

1411
## Input Format
1512

@@ -24,34 +21,28 @@ In the ```main.py``` file, set the:
2421
1. ```path_res``` variable to the path where to find the csv file
2522
2. ```output_dir``` variable to the path where the resulted comparison will be saved
2623

27-
### Extract Comparisons
28-
29-
To extract the comparisons in a json format, the function ```get_analysis``` should be used as in [this line](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/b911733153dbc3d578e649c062385700e9a2146e/main.py#L8). Set the input parameters as ```save_json=True``` to save the ```analysis``` dictionary in json format into ```output_dir```. Information about the input parameters of the ```get_analysis``` function are available [here in the docstring](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/b911733153dbc3d578e649c062385700e9a2146e/ALTAMCBE/ALTAMCBE.py#L25). The resulted analysis are stored in the json file found [here](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/main/analysis.json).
30-
31-
### Plot the HeatMap
24+
## Plot the MCM
3225

33-
To plot the full HeatMap, use the function ```get_heatmap``` as in [this line](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/b911733153dbc3d578e649c062385700e9a2146e/main.py#L13). Information about the input parameters of the ```get_heatmap``` function are available [here in the docstring](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/b911733153dbc3d578e649c062385700e9a2146e/ALTAMCBE/ALTAMCBE.py#L190).
34-
35-
### Plot the HeatLine
36-
37-
To plot the full HeatMap, use the function ```get_line_heatmap``` as in [this line](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/b911733153dbc3d578e649c062385700e9a2146e/main.py#L17), set the ```proposed_method``` string variable to the name of the classifier in question. Information about the input parameters of the ```get_heatmap``` function are available [here in the docstring](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/b911733153dbc3d578e649c062385700e9a2146e/ALTAMCBE/ALTAMCBE.py#L358).
26+
In order for the user to plot the MCM, first thing is to load the ```.csv``` file into a ```pandas``` dataframe and feed it to the ```compare``` function. The user should specify the ```fig_savename``` parameter in order to save the output figure in ```pdf``` and ```png``` formats.
3827

3928
## Examples
4029

41-
Generating the HeatMap on the [following example](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/main/results_example.csv) produces the following.
30+
Generating the MCM on the [following example](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/main/results_example.csv) produces the following.
4231

4332
<p align="center" width="100%">
4433
<img src="heatmap.png" alt="heatmap-example"/>
4534
</p>
4635

47-
Generating the HeatLine on the [following example](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/main/results_example.csv) using proposed methods as clf1 andclf3 in a disjoint manner produces the following.
36+
Generating the MCM on the [following example](https://github.com/MSD-IRIMAS/Multi_Pairwise_Comparison/blob/main/results_example.csv) by excluding ```clf1``` and ```clf3``` from the columns.
4837

4938
<p align="center" width="100%">
50-
<img src="clf1_heatline.png" alt="heatline-clf1-example"/>
39+
<img src="heatline_vertical.png" alt="heatline-vertical-example"/>
5140
</p>
5241

42+
and by excluding them in the rows.
43+
5344
<p align="center" width="100%">
54-
<img src="clf3_heatline.png" alt="heatline-clf3-example"/>
45+
<img src="heatline_horizontal.png" alt="heatline-horizontal-example"/>
5546
</p>
5647

5748
## Requirements

0 commit comments

Comments
 (0)