How to delete included files?

Is there a valid way to completely delete the included files from a project? If I delete them manually by hand via file explorer, then my project won't compile until I restore those files back.
I know that I can excluded from the build but I'd like to know if I can delete them.