Playing with friends on different wifi's (no realms)

Hi, i bought Minecraft for android from google Play store. Then I logged im game to Microsoft account, Xbox account to set to my new account. I wanted to Play with my friend ( on different wifi's) which bought himself a game too. I added him on xbox to have a possibility to Play. Then we tried to connect. I created a world, of course i set all multiplayer options to "on". He saw my game, and tried to enter. Then appeared the message that he couldnt join. We were doing some stuff to make it work properly, we were changing some privacy options, searching for explanation in google, but we didnt find out what had been going wrong. After that i checked a same wifi option(lan) on my sisters phone and it worked. But i still dont know why i cant Play with my friend with other wifi. And i want to add that an invite option, Xbox invite doesnt work, we even didnt know where to look for sent invitation, it didnt appear. Please help us. Im looking forward to hearing from you. Michał Sternik