Hi,
I was wondering why for Quiz4 Q1, a negative sampling of the word "windows" is not a valid answer. As far as I understood from the lectures, this negative sampling is random and even the actual correct word could be selected for a negative sampling.
I attach the image. Thank you!
The idea of negative sampling is to minimize P(w' | c) for w' not having c as a context (Taken from the slide 25). In our case (use, when) is a correct existing context for 'windows' and thus cannot be sampled.
It would indeed not make any sense to have a NEGATIVE sample that is the same as the positive one.
Well,
actually it could occur (with low probability) if another word appears
elsewhere in the corpus with the same context, for instance here if we
had something like "... use teaspoon when... ". But it was NOT the case
in the quiz question.
Follow the pulses of EPFL on social networks
© 2023 EPFL, all rights reserved