4th player can't jump on Xbox version of Minecraft (Series X)

As the summary. Says, when I want to play Xbox Minecraft with my 3 kids, whomever joins last, can't jump. The A button doesn't work. I've tried different accounts and different controllers, more often than not it's always the 4th person to join who has the non jumping issue, but sometimes it happens to the 2nd or 3rd player. It only ever happens to 1 player, but we've never had 4 players on the same console able to use the A button to jump or fly if we're playing Creative.