Professional speaker Patricia Fripp suggests you can sound more polished if you say something more than "yes" or "no" (e.g., "Yes, I did know that.").
Polishing,
Tim Wilson
Professional Speech Coach
Free speaking tips at: http://speakingquicktips.blogspot.com
