Video caller assistant for the blind and visual unpaired people Alexandra Costa , Caio Santana, Cristiana Oliveira, Mário Vairinhos
many thanks to António & Francisco (gitup tweeks)
many thanks to Jeff Thompson (demo code for azure)
ZBeat uses Microsoft’s Azure for a video assistance tool that helps blind people to understand other people’s mood in a videocall. It functions as an assistant(bot), which analyses the facial expression of the person talking, and translates it to a song that corresponds to a certain emotion.
We hope to enhance the video chatting experience for blind people, as well as friends and family, through the introduction of body language in their interactions.
- Open zbeat
- Open skype or any other video call software on the top of the desktop
- Enjoy
A music will be played for each emotion (face expression) that is detected on screen emotions avalailable:
"anger", "contempt", "disgust", "happiness", "neutral", "sadness", "surprise" (customize your own sounds - MP3 inside DATA folder)
Use zbeat now: zbeat v1.0 - Windows 64 Version