Award Banner
Award Banner

Skin in the game: Video chat apps tout 'inclusive' AI features

Skin in the game: Video chat apps tout 'inclusive' AI features
A handout photo. A photo illustration dated June 2, 2021 shows how Google's new light adjustments feature for its Meet video conferencing tool brightens the face of a user who is underexposed because of a window in the background.
PHOTO: Reuters via Google

Video conferencing services have for years boasted that their technology is “intuitive” to use or “integrated” to function with other tools, but now vendors such as Google and Cisco can hardly go a blog post without trumpeting a different attribute: “inclusive.”

The latest buzzword, and the product development that accompanies it, shows how tech companies are newly focused on assuring Black users and other persons of color that online chat products will not leave them out in the cold.

The changes stem in part from the rise of the Black Lives Matter movement - which has prompted vendors and customers alike to think beyond the needs of a white, English-speaking audience - and the pandemic, which created a large "remote" workforce heavily dependent on technology.

Alphabet Inc's Google this month plans to deploy an artificial intelligence (AI) feature that addresses the longstanding issue of darker skin tones being under-illuminated in video chats.

Cisco Systems Inc in January launched a gesture-recognition feature to display a thumbs-up in Webex, taking pains to assure that skin tones would not affect performance.\

Read Also
Google Meet won't limit meetings on free plans until March 31, 2021
digicult
Google Meet won't limit meetings on free plans until March 31, 2021

LogMeIn Inc's GoToMeeting, Microsoft Corp's Teams and Facebook Inc's Workplace are adding translation or pronunciation options in what they describe as an equity push.

"Technology is fundamentally today just not as inclusive as you want it to be," said Jeetu Patel, senior vice president and general manager for Cisco security and collaboration. Setting "values and principles that a product should stand for" has become essential, he said.

The tech industry has long been under fire for a poor record on workplace diversity and a failure to recognize the ways in which product design can perpetuate discrimination.

Worries about bias in video conferencing picked up last September after Colin Madland, a doctoral student at the University of Victoria in British Columbia, Canada, tweeted a screenshot of a Black colleague appearing headless when deploying a virtual background on Zoom.

A handout photo. A screengrab dated June 2, 2021 shows a user during a Google Meet video call appearing underexposed because of the stark contrast in light between the foreground and background.
PHOTO: Reuters via Google

Studies of other AI cropping systems have shown they generate more errors with darker skin, in part because the data used to train them mostly included lighter examples.

Zoom's chief diversity officer, Damien Hooper-Campbell, told Reuters: "Bias was not at play, but rather a combination of the user's distance from the camera, use of headphones, and seating position."

Madland said the problem subsided after his colleague purchased a green screen and some "snazzy lighting."

For Zoom and its rivals, delivering on inclusion could provide an edge while vying for post-pandemic deals with clients - which are facing their own reckonings on diversity.

Global spending on cloud-based conferencing is forecast to reach $5.41 billion this year, up from $5.02 billion in 2020, according to tech consultancy Gartner. It does not track market share, but analysts cite Zoom and Cisco as the leaders.

'Not equally represented'

The upcoming Google Meet feature tackles the problem of people appearing darker because of their surroundings, for example when sitting in front of a window, said Niklas Blum, a Google product leader involved with Meet.

"Users with dark skin tones are not equally represented, and we want to build products for everyone," he said.

The AI separates users from their background, determines whether they are underexposed regardless of their skin tone, brightens the picture accordingly, and finally merges the background and foreground.

Meet's virtual waiting room will prompt users to activate the lighting adjustment when it detects they could benefit from it, said Stéphane Hulaud, product lead for video quality and processing in Meet.

Read Also
digicult
Microsoft Mesh could bring mixed reality to your next video conference

Blum and Hulaud said Meet first identified the representation issues in video when launching a low-light enhancement for mobile calls well before the pandemic.

Developing the latest feature took considerable time, but it led Meet to establish product inclusion testing procedures and mandate them for all of its work.

Google is pursuing additional fixes, too. Meet is pitching laptop makers and operating systems on sharing greater control over cameras' white balance and exposure. Internally, Google adopted minimum light reflectiveness requirements for conference room designs.

At Cisco, the new gesture-recognition option, when turned on, lets users hold up their thumb on camera for about a second to generate a virtual thumbs-up on screen.

Cisco trained its AI to focus on the shape outline and movement of the gesture in time and space, reducing potential issues from variance in skin tone, said Keith Griffin, a distinguished engineer at the company.

Praying hands - for "thank you" - are among possible new gesture options to come, with a feature that interprets sign language an eventual goal. Webex also expects to add skin-tone options beyond yellow for the icons.

A handout photo. A screengrab dated June 3, 2021 from Webex video conferencing software shows Keith Griffin, engineer, CTO Collaboration for Cisco, wearing a dark glove and holding up his thumb to demonstrate a gesture recognition feature, launched in January 2021, in this handout photo. 
PHOTO: Reuters via CISCO

Mike Sharp, LogMeIn's chief product officer for unified communications and collaboration, said education clients have driven some of the company's "inclusion" updates.

For instance, forthcoming support for Spanish, Mandarin and other languages in voicemail prompts and transcriptions will benefit an unidentified California school district that wanted to better engage with its community, Sharp said.

Facebook Workplace, a suite of business communication tools, last month said video town hall hosts soon would see name pronunciations for workers posing written questions.

Product head Ujjwal Singh said the pointers, which are AI-generated but editable, aimed to help executives at clients including Nestle SA  and Booking Holdings Inc  properly address colleagues and promote inclusion.

“I don’t want to mispronounce it to thousands of employees and look like I’m not in touch with the company,” he said.

homepage

trending

trending
    No permission to hold meeting: Chee Soon Juan's allegation of double standards not true, says Sembawang Town Council
    No intention of 'downplaying tariffs': PSP's Leong Mun Wai calls for new trade deal with US
    GE2025: Why this 32-year-old is setting up a political party to contest East Coast GRC
    'We miss cai fan': Why Edwin Goh and Rachel Wan are returning to Singapore after 2 years in Australia
    COE premiums rise again in first bidding for April 2025
    'Workout buddies': Toddler warms hearts by copying older man doing morning exercises daily
    Man charged for allegedly stealing wedding money boxes containing estimated $50k in cash
    This made my day: Free assessment books and exam papers placed outside West Coast home win praise
    Israeli soldiers deserve 'universal condemnation' for killing emergency workers: Shanmugam
    Hello, Sunny! Simonboy announces birth of son, shares scary moment where 'we lost his heartbeat'
    'I felt lonely and upset': Grandma, 73, worked at hawker stall to support grandkids during daughter's imprisonment
    Any takers? Man leaves $60k watch at Merlion Park to test how quickly it's stolen

Singapore

Singapore
    • 10-year-old girl dies, 21 others injured as River Valley fire sees construction workers mount rescue
    • Man pleads guilty to taking upskirt photos at Paya Lebar MRT station, injuring victim while fleeing
    • This made my day: Bus captain driving along TPE slip road praised for stepping in to help boy walking alone
    • PM Wong on US tariffs: Growth will be impacted, leading to fewer opportunities and smaller wage increases
    • 'If you see someone in distress please don't shun them': Motorcyclist offers ride to woman walking in middle of PIE slip road
    • Wake held for Singaporean man, wife killed in Italy gas explosion as probe into cause continues
    • Safer trips for teens, group order with strangers: Grab unveils new features
    • Info from Megan Khung's pre-school gave no reason for ECDA to suspect girl's abuse: MSF
    • WP calls for 'openness to rational and responsible policy' in Singapore amid US tariffs
    • Singaporean drowns after being swept away by strong currents near island off Johor

Entertainment

Entertainment
    • Soundtrack of my life: Stefanie Sun's comeback concert a healing experience for this fan of 12 years
    • 'I was brought back from the brink of death': Taiwanese singer Tank successfully receives heart and liver transplant
    • NewJeans changes social media handles and deletes posts after court ruling
    • 'My brain got so fried up': Gurmit Singh hit by anxiety attack while acting in his 1st Chinese drama
    • Gossip mill: Tanya Chua and Jane Zhang busk at Clarke Quay, top 10 Korean actors among overseas fans revealed, Ryoko Hirosue arrested for alleged assault
    • 'Without daddy, nothing would be tidy': David Beckham 'annoys' wife Victoria and kids by being organised
    • Maroon 5 returning with new album and tour
    • Trump's global import tariffs could lead to China banning showings of US movies

Lifestyle

Lifestyle
    • 140 coffeeshops in Singapore offering SG60 promotions and discounts, here's what to expect
    • Sides, viral fried chicken chain by UK YouTubers Sidemen, to open at Bugis+
    • The rise of Chinese F&B brands in Singapore: What stirs Singaporeans' appetites?
    • AI and art: Studio Ghibli-inspired trend sparks debate on ethics and consent
    • Acclaimed chef Damian D'Silva to helm 2 restaurants at National Gallery Singapore
    • Thrill or chill: Enjoy more for less at Resorts World Genting
    • New platform for a new era: Audi A5 Sedan now available in Singapore
    • A bright minimalist condo apartment with a loft
    • The truth about integrated developments in Singapore: 5 homeowners share their living experience
    • How to pay in China like a local: 2025 guide for foreigners and tourists

Digicult

Digicult
    • A $500 wake-up call: How the Samsung Galaxy Ring made me realise my stress
    • Monster Hunter Wilds producer explains how game has remained unique and fresh over 20 years
    • Western intelligence agencies warn spyware threat targeting Taiwan, Tibetan rights advocates
    • Taiwan says China using generative AI to ramp up disinformation and 'divide' the island
    • Russian court fines Telegram app for refusal to remove anti-government content, TASS reports
    • One Beijing man's quest to keep cooking — and connecting with Americans — on camera
    • Nintendo Switch 2 to launch in June with US$449.99 price tag
    • Games in April: RPGs, racing and Ronaldo in a fighting game
    • Is it time to get a MacBook at a good price? The M4 MacBook Air says yes
    • China's Baidu launches 2 new AI models as industry competition heats up

Money

Money
    • Giant deal: Malaysian company to acquire Cold Storage and Giant supermarket chains in Singapore
    • Trump's tariffs kick in, deepening trade war and market rout
    • Punggol HDB flat sold for $850k marks all-time high for executive flats in the area
    • China not backing down as fresh US tariff threat pushes tensions to the brink
    • Nearly 50 countries want tariff deals, Trump trade chief Greer says
    • Trump threatens to hike China tariffs further as market plunge continues
    • Govt's response to US tariffs 'partly to instil fear': PSP chairman Tan Cheng Bock
    • Stocks dive in Asia, markets hunger for rapid US rate cuts
    • EU seeks unity in first strike back at Trump tariffs
    • US stock futures tumble indicating another plummet on Wall Street

Latest

Latest
  • China calls US trade surplus 'inevitable', warns it's ready for trade war
  • Daily roundup: Enjoy more for less at Resorts World Genting — and other top stories today
  • China nursing home blaze kills 20; 1 arrested
  • After retrial, Hong Kong court jails social worker to nearly 4 years for rioting
  • Trump plans to fine migrants $1,350 a day for failing to leave after deportation order
  • South Korea opposition leader Lee steps down amid expectations of presidential run
  • American academic arrested in Thailand charged with insulting monarchy
  • Dominican Republican nightclub roof collapse kills at least 66, including governor and ex-MLB players
  • British royals greet crowds at Colosseum during Italy visit

In Case You Missed It

In Case You Missed It
  • Ex-MP Lee Bee Wah introduces former MDDI director Goh Hanyan as potential candidate to Nee Soon residents
  • Robert Ng, son of late billionaire Ng Teng Fong, and 3 children to be designated as 'politically significant persons'
  • 'She should be with her family': Employer gives maid plane ticket, $800 to return to Myanmar and search for missing mum
  • 'He needed something to help him fight,' says man who bought Hokkien mee for dying patient
  • Thai woman struggles to evacuate during earthquake while her dog sleeps unfazed
  • Workers painting exterior of Geylang block discover man's skeletal remains in flat
  • 'New, younger' PAP team vows to reclaim WP-controlled Sengkang GRC, says Lam Pin Min
  • New face Jackson Lam 'very good on the ground' and will be asset to Parliament, says Shanmugam
  • Woman who publicised tips on how she evaded GST for luxury purchases fined $18k
This website is best viewed using the latest versions of web browsers.