I finally made it work! I'll explain it here in case someone ever has a similar problem:
I reinstalled the virtualbox extension pack (to use USB 2.0 and 3.0), and the board kept connecting and disconnecting, until it finally could not connect anymore.
To fix this, I had to use a USB filter and remove the product ID, restart the VM and it finally worked! (At least for now)
