The story this week that has been setting social media on fire is the one about the algorithmic miss classification of some photos by Google+. The problem is that it classified a picture of a nice African American couple as “Gorillas.” That’s horrible, and what’s worse is that the only way Google could find to fix the immediate problem was to remove the tag entirely. Obviously, it was a mistake and Google apologized profusely.
Image recognition is much tougher than you might think. I read recently that at any given moment, about 65% of our brain processing power is focused on visual processing. We are extremely good at it, and we evolved that skill over millions of years. We recognize things and people with incredibly few visual clues. Expecting software to be as good as we are is probably unrealistic.
Having said that, this oops moment does perhaps point to a larger problem. Silicon Valley is horribly white. Actually it’s white and Asian, by which I mean mostly Indian Asian. There is a sprinkling of Latinos and about 2% African American. In short, Silicon Valley is a privileged white, first-generation, super-educated immigrant mix. I don’t recall ever seeing a black face in a meeting. Companies like Google promote diversity, but any visitor to their cafeteria (a fantastic place BTW) will be struck by the mass of pencil-necked geeks and button-down collar-wearing senior nerds and the phalanx of Indians (the Indian food there is first class BTW).
If all the diversity you have is white and green card, it’s less likely that anyone is even thinking about checking things like algorithms for culturally disastrous mistakes like this one. Nobody looks like them, so nobody checked. I guarantee that there are special routines built in to check for things like Native American vs. Indian sub-continent. I wouldn’t be surprised if there is special code to try to differentiate various Asian groups, but clearly not black.
It’s a problem without an easy fix. Graduation rates, etc. are lower in some communities, but companies like Google could invest in urban tech programs. Maybe fund a few charter schools in cities that aren’t San Francisco. At the very least, they could check modules like the one in question for obviously offensive situations like this one. If you live in a bubble, this kind of thing is likely to keep happening.