If, for some reason, it is important to get the d-u done in the moment (I don't know why, but it could be), then you can go ahead with it, and then you can simply reinstall the headers packages that you require. I've done that a couple of times, just out of curiosity, and it has always worked to put the system back as it it should be.