Not a bad shout. Not EVERY page, but if you have a five page site, you might as well pull in all five at the time, and save the other four requests later.
The actual HTML is only going to add another few KB.
I'm sorry that I don't feel it very efficient, because sites with dynamic contents like HK or eCommerce/financial sites, very page is different from minute to minute.
But caching the skeleton of the page will work. We need browser to do it for us, just like browsers already caches the images.