Am I able to give a numeric value to a cell I have filled with a color?

Question

I am trying to make a color chart for my classroom. I would like to be able to add these cells together to get totals based on the color the cell given.

I am using cells b3:ao3

If I fill-in a cell with the color yellow I want it to represent 1.

If I fill-in a cell with the color red I want it to represent 2.

I then want to be able to total b3:ao3 with these values.

Maybe I am unable to do this, but any help is appreciated even if it is to tell I can't. :)

Cristy