Slow loading while in skybox then a timed out error message occurs

Upon joining the server it takes around a minute to load the entire world and once the world loads my inventory is temporarily empty. I then move around in a circle to give information for the host to tell what differences are occurring and then my inventory loads in and about 5 seconds later I get the timed out error message kicking me from the server. This issue has been only occurring on that world since the server host tried to host another world to see if the problem occurs in the new world in which it does not.

Then the server host gave the information on what is happening on his side which is the following:

When he spawns in on my server his body is there the second it says he has joined the server. If he was in the air the last time he timed out, he will not be affected by gravity and thus stay in the air, on his screen presumably in the void, until a few seconds where he is loaded in I can honestly see him moving around, and then in an instant I see him freeze completely, although hearing him makes it seem like he has a slight bit of freedom even after I've seen him freeze, followed by a time-out no longer than 10 seconds later.