"Stay Hydrated!" achievement doesn't work

The “Stay Hydrated!” achievement wont work on Windows. I tried several times and I never got the achievement. I even have several fully grown happy ghasts from playing on Windows already and I never got the achievement. I was able to get the achievement on Android very easily, so I think this is an issue with Windows.