Game doesn't pause with esc button

I paused my game by hitting the escape button, but when I un-paused it, I died instantly and saw the day and night cycle go through a few times. It pauses the game, but then you go back to it, it pretty much "fast forwards" what would have happened if it weren't paused.