Minecraft does not create a world icon if it is missing but also disables the "Reset Icon" button.
There are two cases in which a world can have no icon:
The world was generated in a previous version
You close the a newly generated world before entering:
Create a new world
Minimize Minecraft
Open Minecraft after it finished generating the world and exit back to the main menu
Seems to be fixed or I was just wrong with this