Cannot join friend's world by pressing [Join] button

I cannot join my friend’s world by pressing green [join] button in play menu, I need to wait for 3~5 mins to join my friend’s world (I don’t know why)