If you pick "exit" it exits. If you click the close button, it just closes the window but keeps running. You can also set in settings not to run on system startup. Mac has the same behavior.