"Unable to connect to world" when I try to join a friend.

When I try joining my friend it says unable to connect to world. To give sort of a brief summary, basically me, and 3 other friends play on one of our friends world (I'll just call him Joe for simplicity). We used to be able to join Joe's world perfectly fine but randomly one day it just didn't let us join. All it said was "unable to connect to world". Today, one of my friends could join Joe's world but me and the other friend couldn't. We have literally tried every possibility we can think of, I turned my phone off and back on, restarted minecraft like 50 times, unfriended and re-friended Joe and even logged out of my XBOX live account and logged back in. I can already answer some questions I am guessing you will have, 1) No it isn't our WiFi because we can join the other friend who joined Joe. 2) Yes we are all on the same game version, we all checked. 3) It isn't Joe's WiFi as the other friend can join it. 4) We are only having this problem joining Joe's world, Joe and the other friend have issues joining my world too. 5) Yes I did check my privacy settings but I cannot find anything related to joining games. 6) Yes we did try inviting but that just gives the same result as joining normally. 7) I can join other servers like the Hive and stuff since my friends and I play on them regurarly. I did update my iOS thing , I'm not sure if they did but I don't believe it should play a big role in this situation.