Thank you muungwana and Rudge again for your help.
Changing the driver to "nv" as instructed above in this thread made a world of difference. Now my X process use of CPU% is significantly lower - now 10%, maybe rising to 25% under load. The system responds again like it should. I wonder why this "nv" driver was not the default but I guess different hardware responds to different drivers.