Thank you for raising this important issue. Of course, not all accusations are alike. It might feel more like a slight chiding or a gentle reminder. In this rather innocuous case, you can assess the feedback and adjust accordingly.
I believe the accusation you have in mind is more akin to a tense, sharply delivered statement that not only accuses you of malfeasance but feels like an attack. As you fall under a verbal assault—say, one that questions your reliability, integrity, or talent—it’s likely you’ll become angry in return. When this happens, your natural response to what feels like a mild physical threat is to move from your “know” to your “go” system and react in a defensive and also stupid way.