When you put armor on an armor stand, you cannot get the armor off the stand

Armor stand issue
I thought that I could get my armor back
I think I should be able to get the armor back

When I right clicked to get my armor back the armor won't come off

Steps to Reproduce:
1. Put armor on an armor stand
2. Try to get your armor back
3. It will not let go of the armor