The temple in desert villages doesn't have a proper entrance. It just looks like a 1 block high gap to the villagers, as partial blocks are treated as full blocks in pathfinding.
To reproduce, run the following command:
/place template minecraft:village/desert/houses/desert_temple_1
Related issues
relates to
Attachments
Comments

Relates to MC-187455
Can confirm for 20w51a.
Can confirm in 21w03a.
Can confirm in 21w07a.
Can confirm in 1.16.5 and 1.17 Release Candidate 1.
Can confirm in 1.17.
Can confirm in 1.17.1.
Can confirm in 1.19. This issue can now be more easily reproduced by using the "/place" command.
/place template minecraft:village/desert/houses/desert_temple_1
Can confirm in 1.19.2.