Reeling Fishing Rod Doesn't Count as Right Click Action

If you hold a fishing rod in your main hand and some other item with a right click function in your off hand, right clicking the first time casts the fishing rod. However, right clicking the second time will both reel in the rod and use the off hand item's right click function, like placing a block or filling an empty bucket. I believe that's a glitch because the off hand item's function shouldn't be used if the main hand item has one.