>This would mean that the ten or so X drawing primitives have to become implemented >with kernel support as well as support for mice etc.
Have you looked at the X protocol? You are seriously underestimating its complexity.
Tom.