huawei releases AI app that translates emotions into sounds for the visually impaired

huawei has released facing emotions, an AI-powered app that translates emotions into sounds for the blind and visually impaired. developed in collaboration with the polish blind association and a key group of the blind community who were involved in every step of the process, the application uses the back cameras to scan the face of the person with whom the blind person is talking. AI then processes the identified emotion into a defined sound heard on the phone (or in the earphone the person is wearing), all in a real time and in offline mode.

all images courtesy of huawei

the facing emotions app utilizes the powerful camera and AI of the huawei mate 20 pro to translate seven universal human emotions into seven unique sounds. created by blind composer tomasz bilecki the sounds are short, concise, simple and non-invasive for the user and their environment.conveying the emotions to other visually impaired people. sound samples were then tested by a team of blind consultants, who rated them as easy to remember and understand.  huawaei has also released a holder designed to make the use of the app more intuitive, which can be worn around the neck.