There has to come a point in your life where your character speaks for you. People are going to always have something to say and that’s ok. Those who really know you, know your character and therefore won’t believe everything they hear. Those who don’t know you should be mature enough not to believe everything they hear. Do not worry about defending yourself against the words of other people. Let your actions speak for themselves. Hence the phrase, actions speak louder than words!
Matthew 5:16 ESV “In the same way, let your light shine before others, so that they may see your good works and give glory to your Father who is in heaven.”