Villagers Stuck Trying to Get Through Vertical Stacked Trap Doors

I'm using 2 vertical (open) trapdoors as a single two-block high window, where the top trapdoor hinges at the top and the bottom trapdoor hinges at the bottom. The trapdoors are flush with the interior side of the wall of the building. Villagers keep getting stuck trying to get through these "windows" to pathfind to beds and job blocks.

I've included images showing the exterior and interior with the villagers trapped, as well as the interior after setting the trapdoors to horizontal with the villagers then able to come into the building.