Fishing line not returning

In the sky, on a server, when I aim straight down, sometimes the fishing line will not return, even if I switch away from the rod, and if I remove the rod from my hotbar and put it back, I will get kicked from the server with the message "Timed Out"