I did this today. I was late for work and didn't have time to sit and have my morning cup of tea, so I took the mug on my walk to the station. It was definitely worth it, and helped to ease the shock of emerging into freezing, unwelcoming greyness that was London a few hours ago.
I recommend everyone else try this if they don't already do it. It's a very liberating experience.