vibrant visuals makes the game laggy after i leave the world and rejoin

After I turn on vibrant visuals on my world, everything is like smooth and it has barely any lag, even when the settings are on high. But then when I leave the world and then rejoin it suddenly becomes insanely laggy even when I changed the settings to it’s lowest.