People with communication impairments, e.g., those with hearing loss or non-verbal autistic people, are a non-irrelevant number in modern society, so their inclusion is a very important issue. Different approaches can be used to achieve this, and in this paper we consider the use of sign language as a bridge to connect them with the rest of the world. To this aim, we propose an enjoyable and playful approach based on the use of an Elf Sanbot robot. We thus introduce two new applications that we have developed to interface with the robot. They can be installed in a smartphone or in a tablet, and can be used to remotely control the robot via Bluetooth or WiFI connection. The first application, called Sanbot Manager, is used to regulate the movements of the robot in the space and of the head. The second one, called Sanbot Server application, allows for interfacing the robot with a human, that proposes vocal or textual words or sentences, and the robot reacts by showing the corresponding video in sign languages on the robot’s screen. We think that these two applications, and in particular the Sanbot Server application, could be used to stimulate a person with a communication impairment, therapists, relatives, friends, to learn a sign language in an enjoyable way.

People with communication impairments, e.g., those with hearing loss or non-verbal autistic people, are a non-irrelevant number in modern society, so their inclusion is a very important issue. Different approaches can be used to achieve this, and in this paper we consider the use of sign language as a bridge to connect them with the rest of the world. To this aim, we propose an enjoyable and playful approach based on the use of an Elf Sanbot robot. We thus introduce two new applications that we have developed to interface with the robot. They can be installed in a smartphone or in a tablet, and can be used to remotely control the robot via Bluetooth or WiFI connection. The first application, called Sanbot Manager, is used to regulate the movements of the robot in the space and of the head. The second one, called Sanbot Server application, allows for interfacing the robot with a human, that proposes vocal or textual words or sentences, and the robot reacts by showing the corresponding video in sign languages on the robot's screen. We think that these two applications, and in particular the Sanbot Server application, could be used to stimulate a person with a communication impairment, therapists, relatives, friends, to learn a sign language in an enjoyable way.

Learning Sign Language from a Sanbot Robot

Flaminia Luccio;Diego Gaspari
2020-01-01

Abstract

People with communication impairments, e.g., those with hearing loss or non-verbal autistic people, are a non-irrelevant number in modern society, so their inclusion is a very important issue. Different approaches can be used to achieve this, and in this paper we consider the use of sign language as a bridge to connect them with the rest of the world. To this aim, we propose an enjoyable and playful approach based on the use of an Elf Sanbot robot. We thus introduce two new applications that we have developed to interface with the robot. They can be installed in a smartphone or in a tablet, and can be used to remotely control the robot via Bluetooth or WiFI connection. The first application, called Sanbot Manager, is used to regulate the movements of the robot in the space and of the head. The second one, called Sanbot Server application, allows for interfacing the robot with a human, that proposes vocal or textual words or sentences, and the robot reacts by showing the corresponding video in sign languages on the robot's screen. We think that these two applications, and in particular the Sanbot Server application, could be used to stimulate a person with a communication impairment, therapists, relatives, friends, to learn a sign language in an enjoyable way.
2020
EAI GOODTECHS 2020 › Serious Games to Improve Quality of Life
File in questo prodotto:
File Dimensione Formato  
Learning_Sign_Language_from_a_Sanbot_Robot.pdf

non disponibili

Tipologia: Versione dell'editore
Licenza: Accesso chiuso-personale
Dimensione 3.87 MB
Formato Adobe PDF
3.87 MB Adobe PDF   Visualizza/Apri

I documenti in ARCA sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10278/3728361
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? ND
social impact