Villages don't have villagers in them

YES! I was playing on my survival world and I found two villages within a couple hundred blocks of eachother. Both of them were deserted except for one baby villager (i trapped him of course). This is really frustrating.

UPDATE: I found one single villager in the other village. I now have two.