“No, sorry.”
While this might come off as harsh to you, especially if it’s one of the first times you’ve been direct, it’s the most effective. If you waffle between 'maybe' and 'I’m not sure,' when someone asks you a question, they know there’s a chance to get you to say 'yes'. However, when you’re firm in your response, all that person can do is accept it.