Sometimes game is running in background, even though I closed it

When I close the game using any way to close it ( ALT+F4 & Quitting with normal way ), sometimes the game is running in background until I press End Task on the task manager. (focus on the taskbar and Minecraft task manager)