Switching from Creative to Spectator doesn't conserve momentum

When switching from Creative mode to Spectator mode (with both F3+N and F3+F4) while flying, the player stops immidiately and does not conserve its momentum.

Trying to do the opposite, going from Spectator mode to Creative mode, the momentum is conserved.