Partial vision loss can make life difficult for over 6 million Americans. People with visual impairments that cannot be improved with glasses or contacts can have a hard time navigating the world safely.
Computing and Augmented Intelligence students, part of Arizona State University’s IRA A. Fulton School of Engineering, will be able to use artificial intelligence or AI to help visually impaired people experience the world around them more fully. I’m researching.
Kelly Raines is working on a Masters in Computer Science through the Fulton School’s accelerated Masters degree program. After being awarded a Bachelor’s degree in Computer Science in Fall 2024 with an emphasis on Software Engineering, Raines joined the program.
As an undergraduate, she connects with opportunities in the lab for the assessment of autonomous systems and is a research group led by Ransalu Senanayake, an assistant professor of computer science engineering at Fulton School. Under the supervision of Senanayake, Raines has developed AI that can use smart glasses, including Ray-Ban Meta AI glasses, allowing them to ask questions about the environment and help with informed decisions. I supported someone.
In January, Raines received a special recognition for his work from the Computing Research Association (CRA) and was given an honorable mention with the Outstanding Undergraduate Researcher Award. The award program is designed to recognize and nurture the development of talented North American computer science students.
See the real solutions for artificial intelligence
The Lens Lab Project aims to leverage the features that smart glasses already have and combine them with new features specifically designed to help people with visual impairments. Smart glasses can already capture photos and videos, recognize common objects within them, and combine digital information with real images.
At the early stages of the project and for previous work, Raines interviewed members of the visually impaired and blind community to better understand their needs and experiences. The team recognized that safety and reliability at design time were the biggest concerns.
Raines and the team created an AI-driven assistant that acts as a visual guide. Once smart glasses collect images, the wearer can speak questions aloud and ask for details. People may ask their AI assistants how many steps are in front of the stairs, identify objects in the distance, or read the text on street signs.
Raines explains that the team’s goal was to combine the various technologies already available to create new solutions.
“My research has explored the current capabilities of cutting-edge AI models,” she says. “We wanted to use the best model to accurately describe the environment, understand spatial reasoning, and assist with other important tasks of navigation.”
Senanayake says he is proud of Reigns’ work and believes that research can play an important role in student development.
“Kelley is an incredible student and an avid researcher who worked hard on the project,” Senanayake says. “Her award from the CRA brings a new form of AI that will help ASU students combine creativity, enthusiasm and technical skills to enhance individuals with a variety of abilities and provide greater independence and accessibility in everyday life. It shows you are creating technology.”
Raines agrees, saying research opportunities will help students find a sense of purpose.
“I didn’t have a family in the tech field and I didn’t really grow up interacting with programming until college. So I felt everything was so unfamiliar and new. I was going to start. It was almost difficult to do,” she says. “But research is one of the most useful pathways to discover topics you enjoy.”
Techie of Tomorrow Eyes Careers Create Positive Change
While working at Lens Lab, Raines co-authored papers published at the Top Research Conference, won an internship at ViaSat, and supported the AI project for Satellite Internet Company.
Raines’ latest honor is particularly important given the role of CRA in computing research. This group is a consortium of over 250 organizations working in research, and is particularly dedicated to research advancements.
Nadya Bliss is Executive Director of the ASU Global Security Initiative and chairs the CRA Computing Community Consortium. In both roles, it is important to promote student participation in computer science research.
She says this perception is a encouraging validation of student and teacher efforts in the schools of computing and augmented intelligence.
“These awards honor undergraduates who show their true commitment and passion for calculating research,” says Bliss. “This perception shows that ASU faculty is creating challenging learning experiences and that students are rising to the opportunity to create impactful work.”
For her, Raines plans to continue to find more ways to make a difference using AI.
“I want to utilize my master’s degree in any kind of media, interactive environment, or creative work that can have a positive impact on the world,” she says.
