Fellow speaker,
When practicing your speaking, memorize some transitions so you can repeat them quickly and easily. When people are talking and changing from one point to a different point, they often "lose" themselves on the transitions. That's when the "ah/ums" really set in. Make sure you know your transitions in advance so you move smoothly and easily from point to point.
Pointedly,
Tim