Chunks behind player don't render when switching F5 mode until camera moves

When switching into the 3rd F5 mode (face view), the chunks behind the player won't render at first.
In singleplayer this lasts for about half a second, but when you're playing on a server, they won't render until the camera moves (I waited for about 5 minutes by now).
The same bug occurs when switching back to 1st person or the from-the-back 3rd person view.