Fellow speaker,
Sometimes you put on an event and you get only a few people showing up. Instead of giving up, keep it up! Give everyone who did bother to come out a great show, tell them about your next event, get them on your mailing list, etc. Build from that moment so you keep growing from event to event.
Growing,
Tim