Me and sibling can't join each others worlds but can join others

For odd reasons when ever me and my friends play on our own worlds it works but when my sibling tries to join it always says unable to connect to world. We can't join each others server but I can join my friends server and he can as well but we can't join each others worlds.