Can’t accept my friends invite to his realm

I can join his realm if i type up the code but i cannot accept his invites, all it say is cannot connect to world. So when i leave the game i have to retype the code each time