Removing the pulseaudio package may force the removal of the
ubuntu-desktop metapackage. However this metapackage is there for
managing upgrades, so removing it does not remove the GNOME desktop too.
After removing pulseaudio, I recommend installing a mixer applet which
can control ALSA directly, such as gnome-alsamixer: