Clicky

November 13, 2024
Find Solution AI facial expression reading software mapping facial muscles to assess emotion
World

In Hong Kong, this AI reads children’s emotions as they learn

By Jason Diego / February 19, 2021
The software, 4 Little Trees, was created by Hong Kong-based startup Find Solution AI. While the use of emotion recognition AI in schools and other settings has caused concern, founder Viola Lam says it can make the virtual classroom as good as — or better than — the real thing.

Students work on tests and homework on the platform as part of the school curriculum. While they study, the AI measures muscle points on their faces via the camera on their computer or tablet, and identifies emotions including happiness, sadness, anger, surprise and fear.

Facial expression recognition AI can identify emotions with human-level accuracy.

The system also monitors how long students take to answer questions; records their marks and performance history; generates reports on their strengths, weaknesses and motivation levels; and forecasts their grades. The program can adapt to each student, targeting knowledge gaps and offering game-style tests designed to make learning fun. Students perform 10% better in exams if they have learned using 4 Little Trees, says Lam.

Lam, a former teacher, recalls finding out that certain students were struggling only when they got their exam results — by which time “it’s too late.”

She launched 4 Little Trees in 2017 — with $5 million in funding — to give teachers a chance for “earlier intervention.” The number of schools using 4 Little Trees in Hong Kong has grown from 34 to 83, over the last year. Prices range from $10 to $49 per student per course.

Lam says the technology has been especially useful to teachers during the pandemic because it allows them to remotely monitor their students’ emotions as they learn.

4 Little Trees lets students earn coins for learning on the platform, which motivates them to keep studying.

Chu believes the technology’s benefits will outlast the pandemic, because it reduces his admin load by creating and marking personalized classwork and tests. And, unlike teachers, the expression-reading AI can pay close attention to the emotions of every student, even in a large class.

An app that measures pain could help people with dementia

But technology that monitors children’s faces raises concerns about privacy.

In China, AI that analyzes biometric data for surveillance purposes in schools and other places has sparked controversy.

Lam says 4 Little Trees records facial muscle data, which is how the AI interprets emotional expressions, but it does not video students’ faces.

The AI tracks the movement of muscles on a student's face to assess emotion. For example, if the corners of their mouth are raised, the machine detects happiness.

Pascale Fung, director of the Center for AI Research at Hong Kong University of Science and Technology, says “transparency” is key to maintaining students’ privacy. She says developers must get consent from parents to collect students’ data, and then “explain where the data is going to go.”

Racial bias is also a serious issue for AI. Research shows that some emotional analysis technology has trouble identifying the emotions of darker skinned faces, in part because the algorithm is shaped by human bias and learns how to identify emotions from mostly White faces.
Lam says she trains the AI with facial data that matches the demographics of the students. So far, it has worked well in Hong Kong’s predominantly Chinese society, but she is aware that more ethnically-mixed communities could be a bigger challenge for the software.

Experts say emotional expression can vary between cultures and ethnicities.

Lam says Find Solution AI’s emotion recognition works with 85% accuracy in Hong Kong. Fung says algorithms with “very good settings” can correctly identify primary emotions, such as happiness and sadness, up to 90% of the time.

However, more complex emotions, like irritation, enthusiasm or anxiety, can be harder to read.

Smart sensors could track social distancing in the office

“We can hope for 60% [or] 70% accuracy,” says Fung, adding that most people can’t identify complex emotions with a greater level of accuracy. “Human beings are not good at reading facial expressions” she says. “We would like to train machines to be … better than the average human.”

As the AI improves, Lam hopes to develop applications for businesses, as well as schools, to better understand participants’ needs and increase engagement in online meetings and webinars.

Where human communication is concerned, AI “can help to facilitate a better interaction,” she says.

You may also like