Game not displaying "Can't earn achievements" button

Game not displaying "Can't earn achievements" button.

How to reproduce:
1. Go to the play screen
2. Click create new world
3. Click create new world on create from template
4. Click on any option that disables achievements (e.g. Creative mode)
5. Observe the "Can't earn achievements" button not appearing on the left side