Ok, I have come across another one! (Hopefully this might help the troubleshooting.)
gksu -a getvirtualbox
When logging in as root to start with, all is running:
(The pop-out does give errors, though - saying installation complete and installation failed at the same time. Foresight alone knows what is going on here...!)
EDIT: VirtualBox does work after a reboot, though...