Vilager pathfinding issues in multi-level villages

Villager pathfinding is really bad. I have been building a large village with houses built underneath houses, I also have a very tall tower in which I have placed beds.

The tower has a spiral staircase around it, so the villagers can access each level. The staircase has fences to keep the villagers from falling off the side. The villagers often have problems getting to their beds in the tower, they do assign themselves to the beds and can reach them most of the time, but often times there will be a few stuck in other buildings, showing the anger particles.

Another issue is, when some of them wake up, they will stand at the fences showing anger particles because they can't get down. It is annoying, because villagers on the same level will make their way down no problem.

I have seen similar issues marked as resolved when this isn't the case. In the picture you can see the issue I'm talking about, the staircase I'm stood on is currently the top level of the tower, you can see a farmer villager is having issues pathfinding to the composters I have placed inside the wheat farm.

I suggest changing the pathfinding, if the currently chosen path doesn't work for 5 seconds then they should wander and find another solution instead of tunnel visioning.

I have also noticed another bug, where villagers will get stuck in stairs at floor level. In that photo, you can see a bunch of baby villagers stuck in stairs on the floor, this happens with adult villagers too.

I think this all stems from an issue with part-blocks (stairs, fences, slabs, beds) not working well in their pathfinding.