How old are babies when you should take away their pacifier? I don't want him to get too attached!?

I say do it when they are still young. I took my sons away at about 6 months. The younger the easier I think.