Adding different weight on tests

[NoahVanH]

Hello,

I was wondering whether it would be possible to add a "weight" column to the .csv file generated by the Kathara Lab Checker.

The idea would be that the sum of all weights equals the total score (or total number of tests). This would allow different tests to contribute differently to the final result. For example, simple existence checks could have a lower weight than more important functional checks such as IP verification.

It would also be very useful to make these weights easily configurable, depending on the type of lab. For instance, in DNS labs, I might want DNS-related tests to have a higher weight than basic IP checks.

For example (total weight = 10):

Test Description,Passed,Reason,Weight
Check existence of `r1`,True,OK,0.5
Check existence of `r2`,True,OK,0.5
Check existence of `r1.startup` file,True,OK,0.5
Check existence of `r2.startup` file,True,OK,0.5
Verifying the IP address (10.0.1.2/24) assigned to eth0 of h1,True,OK,4
...

This would allow more pedagogically meaningful grading by emphasizing the most important learning objectives of each lab. (This is the objectif of my master thesis ;) )

What do you think about this approach?
I can help to code this feature, with some help.

[NoahVanH]

@tcaiazzi What do you think? Has anyone tried it yet?

[tcaiazzi]

Dear @NoahVanH,

I didn't have time to see this. But it appears to be a good idea. Now, I'm working on the new Kathará release. Once I've done this, I will also check the weights to understand how to implement them.

If you already have some ideas, please let me know.