When I join my friends’ world we all get pushed around randomly, making it hard to enjoy and play the game. The host is not affected. When this happens, you also have to fight the game so you can mine or build anything.