Punching fence when right clicked

I was recently playing on my Minecraft server when I right clicked a fence and suddenly my character began to punch at it. When held he would continue to punch as if trying to break the fence but would not actually do any damage to it.

Seems as though the game is detecting fences as gates or something and is trying to open them?