Communication is the bedrock of human interaction. Have you ever tried to talk to someone, realized they speak a different language, then switched to it and saw their eyes light up? There’s something beautifully human about connecting with a person in their native tongue. By being more inclusive of different languages, we can get more done and build stronger, more genuine relationships with the people around us.
As the world strives to become a more inclusive place, sign language classes are rapidly growing more popular. However, these classes can be tricky for students with limited opportunities to practice their signing and for teachers who lack clear metrics to gauge student progress.
SignAll wants to change that. Based out of Budapest, Hungary, SignAll offers innovative AI and computer vision-based solutions to streamline American Sign Language (ASL) learning and communication. SignAll’s solutions offer a truly transformative experience in the classroom, enabling students to practice their skills whenever, and however, they want. By providing a fun, easy way for students to learn new signs and giving teachers better visibility into their students’ progress, SignAll is augmenting ASL classrooms across North America by improving student engagement and outcomes. And SignAll’s benefits don’t stop at the classroom, as real-time ASL to English translations hold dramatic potential for the private sector as well.
How does it work?
SignAll’s learning system starts with a relatively simple and inexpensive hardware setup—to get started, classrooms just need a PC, a Kinect, two Intel RealSense cameras, and some special gloves. Once the hardware is in place, the fun can begin.
Each lesson consists of three steps: learn, practice, and quiz. In the first phase, students are introduced to new signs via virtual flashcards and visual demonstrations. Next, students practice these signs by playing games such as Space Man and Word Search, receiving automated feedback in real-time. Finally, students test their knowledge in a short quiz, showing them what they need to work on and automatically generating a report for the teacher.
What’s under the hood?
SignAll’s patented solution leverages Microsoft Azure AI and the Azure Kinect Developer Kit to track face and hand movements down to the smallest detail. Because powerful AI capabilities such as computer vision come standard with Azure and are easily accessible to developers via open APIs and pre-written code blocks, partners like SignAll can focus their efforts on leveraging the world’s leading AI rather than building their own.
Making a difference in ASL classrooms
SignAll’s learning system benefits ASL students and teachers alike. By gamifying lessons and providing real-time feedback whenever students want to practice, SignAll gives students control over their own progress, enabling them to hone their skills at their own pace. For teachers, the customizable curriculum and automated reporting system enables unparalleled insight into student progress and a new way to tailor the learning experience to each child’s needs.