Experience orbs generated from trading with villagers or wandering traders quickly alter their facing direction after a few seconds

When trading with a villager or wandering trader, the XP orbs don't exhibit significant stuttering. However, their facing direction appears to rapidly change, indicating a similar issue.

Steps to reproduce

/attribute @s minecraft:player.entity_interaction_range base set 64

1. F3+B

2. Engage in trading with a villager remotely

Observation: The XP orbs' facing directions rapidly shifted.

Expectation: The XP orbs' facing directions should remain stable without rapid changes.