Well, this issue has been presented since 1.14.
Villager's AI tends to not work in some situations. It doesn't look for a different result in these cases that I've seen so far:
Trying making their way through a flower pot (although I think it's already fixed).
Trying making their way through a trap door.
https://youtu.be/WRg9s2pi1PkTrying walking when climbing a ladder. They cannot get off it.
https://youtu.be/y0DuOgPcf7o
I know these are minor problems, but I built a default-looking village and these issues break with the game experience and it also can lead Villagers to die due to Zombies or Pillagers.
As always, one issue per report - the trapdoor one is MC-50556, if you can find reliable steps to reproduce the ladder one, please open a new report.