I'm not sure how similar goo-gone is to goof-off, but when I tried using goof off for removing emplems, it really seemed to soften the paint and consequently marred pretty easily. So careful as she goes. I now use a solvent that somebody gave me that works a lot better/safer, but I don't know what it is exactly.
As BigJim suggested, many guys have had good luck using WD-40...so maybe try that approach first. Then go to a solvent.
The best method is costly - body shops have an air powered tool with a rubber eraser-liker wheel that handles the job in short order, and without deep marring, but the wheels don't last long and are $20 each.