If I summon an invisible armor stand with a name tag, it can't be mined

Every time I summon an invisible armor stand with a name tag, and then try to mine it, it won't go away.