Problem with animals and villagers

Everytime i collect me some animals and villagers and dont play for like two day i come back and all my animals and villagers are gone, the only ones that dont disappear are my rabbits and pandas.