Students talking over me..

I had a colleague ask me the other day what to do when students (5th grade) talk over her... I told her that I very rarely raise my voice, but that I do single out students who are being rude. If this doesn't work, I take away privileges (usually minutes off recess). She was a bit surprised, thinking that taking away recess might make students resentful. Am I wrong?