Flash Read

When the research isn’t what you want to hear

Digital Transformation

December 9, 2020
·
5
min read
An image of Google sign from Google headquarter

If you don’t like the findings of your research team, what do you do?

Now, it seems, we know what Google does, as evidence mounts that it ousted lead ethical AI researcher Timnit Gebru (according to Google, Gebru ‘resigned’, though Gebru’s colleagues have now publicly disputed this).

Gebru’s departure centers around a research paper she co-authored. Google was not happy about the contents of that paper and asked Gebru and other researchers to retract their co-authorship of the paper (a summary of the paper has been published by MIT Technology Review).

If you follow AI ethics research, you’ll be familiar with Gebru. She co-authored a paper a few years back with Joy Buolamwini; a paper that detailed findings of racial bias embedded within the data that powers facial recognition software. The paper laid the groundwork for the likes of IBM and Microsoft to eventually pause their facial recognition technology research.

You would presume that by hiring a prominent AI ethicist in Gebru, who also co-founded Black in AI, Google was signaling an intent to pursue AI research that was cognizant of the ethical problems that have arisen, to ensure that its technology would not be built on similarly biased practices. Until, that is, Gebru wouldn’t stop questioning the research once she was on the payroll. It should be noted this is the second renowned AI ethics researcher to publicly find their position at Google untenable two years running, following Meredith Whittaker’s exit in 2019.

We can’t be sure of the situation from the outside, but if there’s any gray area over whether an employee has been fired or not, a company probably needs to take a close look at its HR guidelines and labor laws. This has been a mess whatever the outcome.

While we await further details, there are some serious questions for Google, and indeed, the wider B2B world.

How often are researchers and technical teams being told to whitewash ethical or other concerns? IT leaders have told Pulse of the pressure that exists to security issues, so what else goes on behind closed doors? Perhaps more external auditing or regulation is the solution here.  

As the SaaS model becomes the norm for businesses, are we questioning the story of the data, methods or practices of business partners? These are questions that don’t just impact our work lives but also hit us on a human level. Google employees have already spoken out against the actions taken against Gebru, just as Facebook employees have spoken out against its practices in the past. Are there systems in place that allow employees to express concerns about partners? More importantly, are employees able to comfortably express ethical concerns in-house?

While humans are still in charge of creating, maintaining and deciding how we use new technologies, we should keep questioning our own practices, and be open to research that warns against certain business practices. Even if the answers aren’t what the business wants to hear.

Access data and intelligence from thousands of verified technology CxOs, VPS, and Directors, while engaging in compelling conversations about what's top-of-mind for tech leaders today.

Join the Pulse Community

Join the executive community

Make and shape business decisions with tried-and-true advice and benchmarks from technology leaders

Executives powering Pulse

“With its survey data, Pulse skips the anecdotes and provides deep context and real numbers for the topics that are top of mind for my organization.”
Julie Cullivan photo
Julie Cullivan
Chief Technology and People Officer, Forescout
“Pulse beats any other platform, research company, Slack groups, etc. at getting me the most relevant advice and content. I rely on Pulse for all knowledge and insights. The answers are consistently exactly what I need.”
Roberto Torres photo
Roberto Torres
CTO, Taimingo
“What the IT community has needed is a vendor free, agenda free platform which encourages discussion and debate amongst peers. Pulse has nailed that in both their Q&A and timely reports.”
Lee's headshot
Lee Vorthman
CSO, Oracle
“I love that Pulse is a one-stop shop for all the peer conversations and insights that are presently super scattered and disconnected among various Slack channels and other CIO groups.”
Enrique Jenkins photo
Enrique Jenkins
Head of IT, DoorDash
“Being able to drive discussions on new tech with my peers and getting immediate feedback is exactly what has been missing until Pulse.”
Manjit Singh photo
Manjit Singh
CIO, Toyota
“For the past two weeks, the first news source I check [every morning] is Pulse. I look at Focused Five everyday. Pulse first, then Twitter, etc. You're that good.”
Miguel Borbolla Olea photo
Miguel Borbolla Olea
Director of IT, OCESA
“I’m excited for what the Pulse team have built to better connect the CIO community. It’s been exceptional for many of us in the community to get clarity and aid decision making as we develop our strategy.”
Yusuf Khan image
Yousuf Khan
CIO, Automation Anywhere
"Transformative change and real-time insights can only come from the people who are doing it day to day in an innovative way. I get a wide variety of that insight from Pulse."
Malcolm Harkins photo
Malcolm Harkins
Chief Security and Trust Officer, Cymatic