isn't that much of a big deal right?

I'm trying to change sim cards (keeping the same phone) but each time I put the new one in, it tells me to insert correct sim...
Is there some kind of special thing one needs to do before you can put in a new card? Do you have to shut off the original sim somehow? What do you do? Am I a retard?

Thanks.