I have to say The Offspring. The first song that I heard of theirs was Pretty Fly and I can't stand that song. Besides that one song, I'm hard pressed to find any of their other songs that I don't like.

Sublime comes to mind. I'm not a huge fan of the song Santeria(it's growing on me, though) but I like most of their other songs.

This is harder than I thought it'd be because I generally don't give the band a second change if they blow their first.