Cant connect to friends worlds if they have too many addons installed.

If i try to join my friends world with addons, sometimes it wont let me connect. it usually occurs if i try to connect to a world with 30-40+ mb of addons. itll freeze partway through downloading and say something along the lines of failed to connect to host, if the world is still being hosted check your internet connection. however my internet is fine, and the person who made the world hasnt left or anything. ive tried restarting the game and trying multiple times, this has happened with multiple worlds over multiple months, the only way to fix it seems to be to remove some addons.