Those car dusters scratch the crap out of car paint/clearcoat. I used them 20 years ago, but haven't since I learned of the damage they can cause.
If you damaged the paint or clearcoat with a car duster I think the problem was on the end of the handle. Car dusters are used at car shows everywhere on vehicles with far more value than any Mazda. Use only the California Car Duster brand and follow the instructions to the letter. I've been using them for at least twenty years and have never damaged the finish on any car.