With PA enabled you could have used pavucontrol (PulseAudio Volume Control) to enable the sound to the sound sink you wished, or even to disable any sound sink you did not wish to be used.
Later you could enable it if required and set particular applications to use it while others use the other sound sink.