Outlook reminds you of due tasks and appointments, automatically fetches your e-mails etc. And numerous Addons depend on that Outlook is running. Of course, all of the functions are only available as long as you don’t close Outlook!
Have you ever accidently clicked the cross in the upper right corner and closed the Outlook window when all you wanted to do was minimize it?