It's not racist when racism has been a historical US policy…
It's not racist when racism has been a historical US policy when dealing with the black population.
You are ignoring historical factors such as redlining, segregation, slavery, etc. that still persist to today ie the 13th amendment