I give a list of generic opt-out excuses when I invite people to an event. That way, if it doesnt sound fun to them, they just pick an excuse off the list instead of trying to make one up and potentionally seem rude.
Its simple, but surprisingly effective for staying on people's good side.