'I remember the Golliwogs on the jam jars with a lot of affection.
As with all these verbal usages, the way it is said is more important than the word itself. We can't know just how it was used without a tape recording.
I think political correctness is getting out of hand - there seems to be a breed of people these days who take some sort of often mock offense in what I regard as a somewhat hypocritical manner.
It's all time we lightened up a bit.'