This has almost certainly been done before - I was inspired by the "albums you love what the band hate" thread, no less - and I bet that that, in turn, was inspired by a thread identical to this. But think of this as the "2011 edition".

Personally, I find "Sweet Loving Man" by The Magnetic Fields to be something of a miracle in music. But, according to the 33 1/3 book about 69, the band hate it. They even seem to take the opportunity to apologise for it. Baffling.