Fishing broke

I am trying to fish in a 3*6*3 deep water hole. Every block is a water source block, but when a fish comes and the fishing hook moves down a bit, right clicking doesn't bring up a fish but also doesn't pull up the fishing hook. After the fishing hook moves back up, right clicking brings up the fishing hook with no fish.
https://www.youtube.com/watch?v=cQ8_Vz8YcvM