So annoying. Yes.
I recommend try getting a task manager sort of app on the store (thats not malware or anything) and end the apps your not using and that aren't system type. I would really be able to help too much as I use Windows 10.0 or Xbox One.
A simlar thing that happens with all items, is that if you put the armour stand invisible without any effects, it will look like it's going with you, but it's just a bug.
You don't report this stuff here...
You report it at InPvP twitter as Mojang did not create InPvP.