The color we perceive an object to be is determined by how it interacts with white light, specifically through absorption and reflection of light wavelengths. The retina contains photoreceptors called rods and cones, where cones are responsible for detecting color in sufficient light. For instance, a red shirt appears red because it reflects the red wavelengths while absorbing others, while white objects reflect all colors and black objects absorb them.