Infinity Enchantment Not Working

I was fighting a Wither and I enchanted my bow with infinity but the arrows in my inventory were lowering like the bow didn't have infinity. Normally, you need 1 arrow in your inventory for the Infinity enchantment to work but it acted like the enchantment wasn't applied.