Probably a texture issue that could be patched, but you're on your own there.
Are you fast travelling to the castle location? Maybe try traveling to the boat instead and manually travel over. If not, try reloading a previous save.
If all those fail, the official BGS solution would be to start a new game.