Groove is one of those apps that keeps popping up and advertising for itself, regardless of if you wanted it or not. Microsoft does not give you an uninstall through the interface, but you can remove it with a simple PowerShell command.
Run PowerShell as an administrator, then run the following command.
Get-AppxPackage *zunemusic* | Remove-AppxPackage