Item displayed in hand when loading new world

When I leave one world with a certain item in my hand and then make a new world (leaving  the game in the background so it automatically goes to the menu), it shows the item in my hand (until I leave the menu, where it then does the animation for switching hotbar slots).