The experience of color is ultimately a bunch of neurons firing in a certain way. The neurons themselves don't experience anything - the entire assembly does, as a whole. From that perspective, it's not clear why the Chinese room can't experience colors, even if individual people-"neurons" only transmit the underlying signals like RGB measurements.