Switching between third and first person view doesn't update chunk view frustum

When you switch perspectives (default: F5) without moving, you can see that the chunks on the side, the camera's back was turned to before, are hidden (screenshot 1), like as they do not render to gain performance and higher FPS. When you move your camera frustum (move character, move mouse, something) it updates and all chunks are displayed correctly (screenshot 2).

In short: The camera frustum does not update when changing perspective.