After a nice hour of sailing I came onto my wreck. I was unable to click it for some reason.
So first I had to F11, then Cancel to finally be able to click the wreck. (Thanks Salzi.)
F11 is in. I'm putting it here so other folks encountering this problem can use the F11 trick.