Yup, confirmed it seems to happen when exit/re-enter world while they are active. I 'believe' that it also occurs when going to/from nether.
Same issue in bedrock (Windows 10) - https://bugs.mojang.com/browse/MCPE-33810. Attached a video that shows the issue 'in action'
Great, can't wait for that to be released to Realms then.