When you touch the world border, you can get stuck in it.
From MC-182732:
When you press against the world border, you don't just stop, you get teleported a littlebit backwards, leading to not being able to move along the world border while looking at least 5° towards it.
Can confirm, this was not an issue in 1.15.2.