Frustratingly, Zoom is even more unaligned with the standard Windows user experience in this regard.
By default, if you press the x icon, then Zoom minimizes to the system tray.
To access Zooms configs, select your user icon, then on configs in the dropdown menu.
To actually close Zoom, right-hit it in the taskbar or system tray, then click Quit Zoom.