I have the same issue. I looked up all the ways to seize control of the folder to no avail. I can not delete the old KSP folder at all. I just want to reinstall KSP fresh and add mods but I can't with the old folder in the way.
Edit: Run msconfig and start in Safe Mode and delete the folder. I just did and it worked.