Take a moment to review the conversation in question. You may have been so vague that colleagues thought you were saying yes when you meant no.