villagers occasionally ruin farmlands even without height gaps
They can walk through farmland blocks, and at a very low chance, they just brake it.
it seems like it happens more when they stand on a block for a while.
(So villagers with no jobs make this problem more often since they just wander through here and there)
Please do not mark unreleased versions as affected.
You don't have access to them yet.