If you're riding a horse, chunks will not load.

If you hop on a horse, chunks don't load right. You go off in one direction, but the chunks loaded are the ones that were loaded before you got on the horse. It's as if the game thinks the player is still back where you got on the horse, instead of attached to the horse. The chunks load once you get back off of the horse.