In addition to the violation of private property rights and the constitutional issues, the other thing about trying to legislate against racism is that the laws actually tend to have the reverse effect.
One example is medical schools, which are required to accept a certain number of minority students. Knowing that some minorities are accepted into medical school based on the color of their skin, rather than on intelligence or test scores, etc, as with all others -- wouldn't you be inclined to discriminate against those minorities when choosing a doctor, regardless of your own skin color? If anything, such laws are backwards. If the goal is to generate respect for minorities, then only the absolute best and brightest should be admitted.
It reminds me of the government's attempts to reduce the impact of imported cars on the American auto industry. A law was passed that limited the number of cars that could be imported. At the time, most Japanese cars were cheap, and not well-respected. But since only a few cars could be imported, the importers changed and started importing the nicest, most expensive cars they could, in order to maximize profits on those few cars. The result was that American's opinion of imports improved, and they became more successful in the end than their American counterparts.
My point is that legislation has side-effects. Even when it seems on the surface like it might be a good idea, it often isn't. On the issue of civil rights, using force to require employers to hire minorities just reinforces racial division. Government talks about wanting a "color blind" society, then enacts laws that force people to pay attention to color. It's backwards! To compound the problem, government forcibly takes money from one group (the people who favored segregation), and uses it to promote the views of another (the people who favored integration). Then people are surprised when racism flourishes. Imagine someone taking your money by force and then using it to support something you despise. Wouldn't that just reinforce your feelings?