Friends can't join when adding resource pack

Anytime I add a resource pack to a world and my friends try to join, they get stuck on loading resource packs, then fail to connect after long enough. If I try to save and exit the world after they attempt to join, I get permanently stuck on “saving world.” This does not happen if they do not attempt to join. I tried this with 3 different resource packs (actions and stuff 1.3, better default 2.1, and the plastic texture pack) and I tried it both adding it to a pre-existing world and creating a new world with the pack already on. For clarification, it works perfectly fine when I take the resource packs off. My friends are both playing on Xbox series S, I am on series X. Also, it worked without issues when I joined one of their worlds with a resource pack added to it.