As the zombies was triggered on me through to "hole-windows" of desert villager, he came close to the door. As the villager noticed that a zombie was close, he opened to door and tried to run off in the distance, except that he and the zombie just kept pushing eachother in the doorframe without damaging eachother at all.
WAI: Husks (and other hostile zombie mobs) would rather attack players than villagers. That husk is targeting you, not the villager.