I made detailed notes the first time I played and was unable to sail directly there. However, I just noticed in the game I'm playing now that a NPC told me that some routes are closed during some seasons (I don't remember which seasons). It could be that I (and you?) am unable to travel there only during certain game months. In my trial run, I only tested it for each day of the week and thereafter went by the schedule I'd drafted. I have the millennium version, and was playing unpatched when I made the notes. Since then, I've patched the game with Mok's patch, but haven't re-checked my notes for correctness.