I think that is the key issue here. If you get past the racial angle, then poverty is the issue. There are proportionally more poor blacks because of the legacy of slavery and racism, but not all poor people are black, and not all blacks are poor. So if you're not focused on the racial angle, and I really think nobody should focus on that, then you should focus on poverty. By alleviating poverty for all you are automatically helping blacks disproportionally, and also on average transferring money from white people to black people, but those are side effects and not at all the point.
It's been said before that even middle class and rich black people have a harder time than whites of the same wealth level. Be that as it may, for most people it would seem as very unreasonable and unfair to further enrich a black millionaire because he is also occasionally victimized by racism. It's a fine thing to fight discrimination, promote diversity in schools and etc so that nobody, rich or poor, is the victim of racism. But to give money to a middle class or rich black person because they face racism or had a harder time getting wealthy than they would if they were white? That's not sensible. I mean, ugly people also have a harder time becoming wealthy and also face discrimination. As do fat people, short men, etc etc.
So we should help people based on their need, not on how many "wrongs" they had to endure. Because those are impossible to quantify, and because it simply would not be fair.