When putting armor on a newly-spawned horse, not only does it equip the horse with armor, it also duplicates it, so you get an extra back for each one you put on. This also happens with different kinds of armor, too (e.g. If you put diamond armor on, take it off, and put gold armor on, it gives you both).
Linked issues
duplicates 1
Comments 2
Duplicate of MC-13675, please use the search function to see if your bug has already been submitted. Currently over 54% of tickets are being closed as duplicate.
1. Single player only
2. You must first tame the horse
3. The horse also needs a saddle