The problem is, society chooses to give it a significant 
    amount of meaning.

But why do we have the society we currently have? Can't we foster a society where race is less important by making it less important to the point it's not a concept we consider at all?

Personally, I felt as though we were progressing towards a society where we were giving it less and less meaning but in recent years we're regressing towards elevating its importance again and that is resulting in animosity.