Lag for non-host players makes game unplayable

Major lag when playing multiplayer on switch. For the host it's fine but for the player that's joining, it's impossible to do anything. There's an almost one whole minute delay for block breaking, damage is taken long after you fall, it will tell you you're drowning when you're nowhere near water, maps won't update your location, you cant open inventory, and you can't even kill moobs. It's unplayable and extremely disappointing. Especially because we are on the same wifi and both playing on switch. We never have problems with any other multiplayer game.