Looking at something rationally should tell us impact is just as, if not more, important as intent, but we humans are not rational. From an interesting article on the topic in Scientific American:
As long as we continue to engage with societal issues in which there is an agent with intentions and a patient receiving the consequences of those actions, we must all struggle to tease apart these issues of intent and impact. We must all focus on how actions that harm others -- regardless of intent -- need to be addressed, not pushed under the rug because the agent "didn't mean" to do anything wrong. Yet at the same time, we must learn to understand our own cognitive biases, and how we can't continue to treat intent and impact as if they are cognitively separate, orthogonal factors.
But here's another take: