Title explained it pretty well. It happens with any arrows and they can be shot from a dispenser too. As long as a player is picking them up the bug will occur. I'm also a linking video here:
https://streamable.com/fj4ty
Related issues
Comments
Asteraoth
migrated
Thank you for your report!
However, this issue is a Duplicate of MC-163575.
If you would like to add a vote and any extra information to the main ticket it would be appreciated.
If you haven't already, you might like to make use of the search feature to see if the issue has already been mentioned.
Quick Links:
📓 Issue Guidelines – 💬 Community Support – 📧 Customer Support – 📖 Game Wiki