One thought is that society creates its own problems through labeling.

People push back on labels when they know a label doesn't apply to them, and rightly so. If a (white) person often participates in (for example) charitable activities with the goal of ameliorating racial inequities, they're not going to particpate in discourse that intentionally or unintentionally tries to label themselves, or white people in general, with a "supremacist" label.

And that's largely where we get stuck in these discussions. Labels get thrown about, everyone starts arguing about the labels, and the underlying systemic issues go unaddressed.

For example: the vast majority people who have problems with the label "systemic racism" would not disagree with you that minorities do not have the same access to medicare care as the majority does; nor would they disagree that minority children get stuck in lower performing schools.

Both are excellent examples of how a SYSTEM, without INTENDING to disavail minorities, in fact disavails minorities.

But any discussion about how to address the problem gets derailed by the label.