If it's a standard chamber, I wouldn't waste the time involved to do it.
If I had a rifle with a match or tight chamber, or if I shot matches, yes.
With a tight chamber, you'll probably have no choice and have to. Keeping your brass consistent for match shooting, is part of the overall game.