Fishing doesn't work while holding the rod in your offhand slot. The rod attempts to cast, but the line immediately returns. This seems counter intuitive based on how other right click use items work which makes me think this is not working as intended.
Edit: after doing further research I see this is a duplicate report. I apologize for wasting time.
Fixed in 1.11.