And you can internalize the effects of vaccination by government sticks and carrots, without having government provide the vaccine.

Of course there's a risk of regulatory capture in that system, that might make it better to let government provide the vaccines in the first place.