I tried to join a game with a Xbox live friend and a thing came up saying an unable to connect to world

I wasn't able to join a friends world, I've tried many times and a message came up saying unable to connect to world