25 Sep 2024

Signvrse’s Vision for Inclusive Empowerment

author profile picture
InABLE Admin
inableAdmin

In 2020, during an outreach session with Young Scientists Kenya in Migori, the seeds of what would become Signvrse were sown. The session, focused on robotics, was lively and engaging—except for a small group of students who stood apart, hesitant to participate. Upon inquiry, it was revealed that these students were hard of hearing, and with no translator available, communication was reduced to handwritten notes.  

This experience led to the development of Signvrse, a mobile app that provides real-time interpretation of spoken language into sign language through AI-based sign language avatars. 

A picture of Sewu-Steve Tawia talking with Elly Savatia and Gheida. Elly and Gheida are standing behind a Signvrse branded booth inside the AT Innovation Village 2024. There are other innovators and attendees standing inside the AT Innovation Village.

A picture of Sewu-Steve Tawia talking with Elly Savatia and Gheida. Elly and Gheida are standing behind a Signvrse branded booth inside the AT Innovation Village 2024. There are other innovators and attendees standing inside the AT Innovation Village.

“Signvrse is more than just a business; it’s a commitment to breaking down barriers. The goal is simple yet profound: to make sure everyone’s voice is heard, whether spoken or signed,” asserts Elly Savatia, Founder and CEO of Signvrse. 

Signvrse’s two-way communication feature enables real-time interaction between individuals who are hard of hearing and those who are not. Most apps focus on one-way communication, but Signvrse bridges that gap, ensuring seamless understanding on both ends. 

Perhaps the most significant distinction, however, lies in its co-creation approach. “We’re not just building a product for the Deaf community; we’re building it with them,” Elly emphasizes. Two rounds of co-creation and upskilling boot camps have allowed the hard-of-hearing community to test the product, offer feedback, and contribute to its development. These sessions also serve as upskilling opportunities, equipping participants with valuable skills in design thinking, innovative prototyping, and more. 

A picture of Elly Savatia talking into a microphone during the Pitching Session inside the AT Innovations Village

A picture of Elly Savatia talking into a microphone during the Pitching Session inside the AT Innovations Village

This collaboration ensures that Signvrse isn’t just user-friendly—it’s user-centered. By engaging the very community it aims to serve, Signvrse builds not just an app, but a partnership grounded in innovation, inclusivity, and empowerment. 

Signvrse has already begun to make an impact in education, healthcare, and employment. One particularly inspiring story is that of Daniel Angila, now the Signvrse Community Lead. A Deaf individual studying at United States International University Africa, Daniel credits Signvrse with opening doors he never thought possible. “Through their boot camps, I’ve gained valuable tech skills and now serve as a Community Lead,” Daniel shares.  
 
Building Signvrse wasn’t without its challenges. One of the most significant hurdles was refining AI algorithms to recognize the nuances of sign language gestures, which vary regionally. “The complexity of these gestures made it crucial to collaborate closely with Deaf communities,” explains Elly. Another challenge was the lack of publicly available datasets for localized sign languages, which are necessary for training AI models. To address this, Signvrse built partnerships with local Deaf organizations, providing the much-needed data to train its AI systems effectively. 

A picture of Elly Savatia and Gheida smiling, standing on the Inclusive Africa conference stage and holding the 1st Runners Up Digital Accessibility and Assistive Technology Innovations Award. Two representatives from the Mastercard Foundation are standing next to them.

A picture of Elly Savatia and Gheida smiling, standing on the Inclusive Africa conference stage and holding the 1st Runners Up Digital Accessibility and Assistive Technology Innovations Award. Two representatives from the Mastercard Foundation are standing next to them.

Continuous user testing also played a key role in overcoming usability challenges. By regularly engaging with users throughout the development process, the team identified and addressed issues in real time. These efforts have led to a product that not only meets but exceeds user expectations, making a lasting impact on communication and accessibility. 

In 2023, Signvrse was recognized as the second runners-up at the inABLE Inclusive Africa Conference. This recognition was a significant milestone for the team, affirming their unique approach to assistive technology. The recognition has also opened doors for further collaboration and growth. It validated the team’s commitment to not only developing an inclusive product but also empowering the Deaf community with new skills and opportunities.  

Looking ahead, Signvrse has ambitious plans. The team is working to automate voice-to-sign language translation, which will complement their current real-time immersive sign language interpretation. A more advanced prototype is also in the works, featuring sign language avatars within a gaming environment to make communication more dynamic and engaging. 

Moreover, Signvrse is incorporating Kenya’s largest sign language dataset into the app, ensuring diverse sign language expressions are represented. The ultimate goal is to scale beyond Kenya and East Africa, adapting the technology to include sign languages from other regions and extending the app’s impact globally. 

A picture of Gheida smiling and standing infront of a branded booth. She's wearing a branded Signvrse black hoodie. She's holding an award written Signvrse, 1st Runners Up Digital Accessibility and Assistive Technology Innovations Award. 5th Inclusive Africa Conference Conference

A picture of Gheida smiling and standing infront of a branded booth. She’s wearing a branded Signvrse black hoodie. She’s holding an award written Signvrse, 1st Runners Up Digital Accessibility and Assistive Technology Innovations Award. 5th Inclusive Africa Conference Conference

Signvrse also aligns with the Kenya Young Game Developers and Animators Incubator Program, contributing to the creative economy while advancing accessibility and inclusivity on a global scale. 

And as AI and technology continue to evolve, their role in creating inclusive environments for the Deaf community will grow significantly. AI-powered tools like Signvrse will improve real-time translation and interpretation, enabling smoother communication between Deaf individuals and hearing individuals. AI will also revolutionize personalized learning, tailoring content to better support Deaf students. 

Moreover, AI’s integration with sign language avatars will make virtual communication more effective, while innovations in assistive devices will further enhance accessibility. As we celebrate Deaf Awareness Month, Signvrse stands as a shining example of how technology can be a force for good, empowering the Deaf community and paving the way for a more inclusive future.  
 
Written by Lily Ronoh-Waweru, Strategic Communications Specialist 

20 Sep 2024

Gloria’s Journey of Empowering the Deaf Community 

Read Next Story