Severe FPS drop when moving

Steps to reproduce

Just walk or fly around, my fps went from 41 to 21, pretty much half whenever you move, it is ridiculous and is making snapshot 14w29a/b very hard to play!