When I'm at home I'm able to connect to my realms, my friend's realms and any of the servers listed under the "servers" tab, however when on college WiFi or using my phone as a hotspot, I get the message "loading resource packs", and then "unable to connect to world" when attempting to join any realms or server. I have tried disabling my firewall and antivirus but neither have helped.
It's possible that your college doesn't allow connecting to Xbox Live on its network. Check with your student services.
On your PC, the college network and your phone would come under Public Networks, whereas your home network would be Private. The firewall uses different settings profiles for Public and Private networks. Are you sure you disabled the settings in the Public profile? (Warning: This, and disabling your antivirus, are very risky things to do. I do not recommend it.)