when more then three people joined my world the players get pushed around and when the players breaks blocks and my game won't register that the block wasn't there until i break it myself

when more then three people joined my world the players get pushed around and when the players breaks blocks and my game won't register that the block wasn't there until i break it myself or blocks disappear after other player place them down