Can't interact with the hidden Ice Caves entrance

Trying to interact with the hidden entrance lets the player pathfind on top of it and the screen starts shaking.

But it is still possible to interact by walking close up and then spamming the interaction.