I think you are wrong in saying that woke crowd believes all white people are racists
The best-selling book on race relations in the United States today is
White Fragility, which takes as its explicit premise that all white people are racist, or at least that they harbour racist attitudes. While it is true that the "woke crowd" does not believe that all white people are
actively or
maliciously racist, but that all white people are racist to some degree is an idea with a lot of currency.
The disconnect is that progressives use "racism" to encompass banal, everyday biases or prejudices, and this is primarily what is
meant by the claim "white people are racist", but conservatives assume that such low-level biases are normal, natural and inevitable, and therefore cannot merit description as "racist", so what they
hear is a claim that all white people are secretly hateful of other races.
This is partly a problem of progressive' own creation, because they have tended to use "racism" to describe this sort of banal racial prejudice only when expressed by white people against non-white people. Expressions of racial prejudice by non-white people are merely that, racial prejudice. This means that they will assert that all white people are racist, but will restrict themselves to the claim that all black people possess unconscious racial biases, an assertion which contains much more nuance, and on the face of it, more charity.
This all makes sense if you subscribe to the famous "power plus prejudice" formulation of racism, because then the nuance is already built into the phrase "all white people are racist". But the vast majority of people simply
don't subscribe to this formulation, aren't even
aware of that formulation; they take "racism" in its colloquial sense of "racial prejudice". This provides conservatives pundits with the opportunity to assert that progressives intend to characterise white people as uniquely toxic and bigoted, an argument which may appeal even to moderate members of the public (including non-white people) who
do not agree with the conservative assumption that some degree of racial prejudice is normal and correct, who
agree with progressives that racial prejudice is a bad thing, but do not
accept as self-evident that there is something categorical which distinguishes expressions of racial prejudice by white and non-white people.
Progressives haven't really prepared a response to this expect to repeatedly outline their own specific, non-colloquial use of terms like "racist", which has so far not been a winning effort, because most people do not actually care what specific weird re-interpretation of colloquial language a particular corner of academia and/or twitter has adopted amongst themselves. Until progressives are prepared to meet people on language which they are comfortable with, instead of expecting that others should assume the fractious and shifting jargon of the progressive middle class, you should expect these sorts of protests, in both good and bad faith.