Anything the court does that is controversial is going to be in danger as long as it's controversial. The reason why racial segregation in schools is not going to come back is not because all nine justices think Brown is right. It's because the country has accepted that it is right.