Evaluation (Exercise 4 exam 2021)

Evaluation (Exercise 4 exam 2021)

par Galann Pennec,
Number of replies: 1

Hello,

I have a question about the answer to the question 4 about Evaluation.

In the correction, the raw accuracy has been computed with respect to the true labels of the transactions.

However, since the reference itself has been generated approximatively in this exercise, shouldn't we compute the raw accuracy with respect to the reference?

Thank you in advance for your help.

Best regards,

Galann Pennec.


In reply to Galann Pennec

Re: Evaluation (Exercise 4 exam 2021)

par Jean-Cédric Chappelier,
Why do you say it's computed with respect to the true labels? It's indeed computed w.r.t. the reference:
S_1 \simeq 1 - (N-20)\times p_f/N = 1 - p_f + p_f^2\simeq 1-p_f
S_2 = 1 - 20/N = 1 -p_f