Fellow speaker,
If you want to master off the cuff speaking, you need to become aware of the setting where you are. Focus on the audience/person's interests and ideas. Bring in mentions of where you are and what's going on around you. This will engage the audience/person and give you an instant connection to them in your talks.
Connected,
Tim