When outside a world border, you realize there is a second world border that's invisible, when you try and throw items throw that border the items surprisingly go through the border even though they're not supposed to since its a border. Now try this with the first world border and you will notice that items cannot go through that border and start glitching.
How to reproduce
Start by teleporting outside the world border using this command:
/tp 29999999 64 29999999
Then grab any item and throw the item at the invisible world border, you will notice that it can go through the border.
Now repeat these steps on the first world border, you will notice that the inside world border prevents items from going through the border.
Observations: Invisible world border allows items to go through, but the world border doesn't allow items to cross.
Expectations: Since the world border doesn't allow dropped items to go through, same thing has to go for the invisible border located outside the world border.
Attachments
Comments

Thank you for your report!
After consideration, the issue is being closed as Working as Intended.
Please note, that mechanics of the game may change between updates.
Things such as graphics, sounds, world creation, biomes, redstone, villagers, and animals may not work the same in current versions.
Full Version History – Snapshot Version History – The official Minecraft feedback site
Quick Links:
📓 Bug Tracker Guidelines – 💬 Community Support – 📧 Mojang Support (Technical Issues) – 📧 Microsoft Support (Account Issues)
📓 Project Summary – ✍️ Feedback and Suggestions – 📖 Game Wiki
The outside world border is not a border. It is purely a limitation imposed on players to keep the game stable. All non-player entities can and will occasionally walk through the outside "border" with no problem. This is intentional.