Skin resets to default after travelling through nether/end portal

After travelling through any portal, mine and my friend's skins revert back to default but only visible to ourselves. This also remains when returning to the previous dimension. Fixes itself upon reconnecting to the server.