Fellow speaker,
It's easy to throw in "filler words" in the middle of our speech, brief "non-words" (like "ah" or "um") that don't add to our speech at all. When you feel a "filler word" "coming on"...pause instead. Pause and let the moment of that "filler" pass, then go on with your speech.
Pausing,
Tim