Hi,
Looking through the solutions of Handson 12, I don't fully understand the solutions to Question 6.
In particular for 6.1: If it's important to find all the documents that are relevant for a given query, then from the perspective of just caring how many of those relevant documents we retrieve both systems are equivalent since they have the same recall. What is it that makes System 2 better here?
Additionally, with 6.2 I don't see why we can in general assume that system S1 is better without knowing more about our evaluation. For example, isn't it possible that the first evaluation does not correspond closely to what will be observed in the real world in which case the second system would be better?
Thank you.