I'd recommend trying to peel back the siding slowly, curling it up around a 2x2. You should be able to loosen a part of it, and use some spray stripper or adhesive remover to help to pull it off.
As for repairing the holes, as long as you've got a good backing behind the metal, sand it down to bare metal and use bondo, you should be just fine. My .02
|