Go Plus: Pioneering Accessible Campus Navigation for the Visually Impaired
Mobile Design
|
UX Designer
|
August 2023
Understanding Accessibility Beyond Interfaces
Understanding Accessibility Beyond Interfaces
Understanding Accessibility Beyond Interfaces
How can mobile experiences become more accesible for visually impaired users?
How can mobile experiences become more accesible for visually impaired users?
How can mobile experiences become more accesible for visually impaired users?
Many digital products still prioritize visual interaction, making navigation difficult for users who rely on screen readers and audio-based feedback in their daily lives.
Through this project, I explored the challenges visually impaired users face when interacting with mobile applications. While the project may not have resulted in a groundbreaking innovation, it became an important learning experience that helped me better understand accessibility from a more human perspective.
More than designing interfaces, this journey taught me how visually impaired users navigate, adapt, and experience the digital world differently — and how thoughtful design can help create more inclusive experiences.
Many digital products still prioritize visual interaction, making navigation difficult for users who rely on screen readers and audio-based feedback in their daily lives.
Through this project, I explored the challenges visually impaired users face when interacting with mobile applications. While the project may not have resulted in a groundbreaking innovation, it became an important learning experience that helped me better understand accessibility from a more human perspective.
More than designing interfaces, this journey taught me how visually impaired users navigate, adapt, and experience the digital world differently — and how thoughtful design can help create more inclusive experiences.
Many digital products still prioritize visual interaction, making navigation difficult for users who rely on screen readers and audio-based feedback in their daily lives.
Through this project, I explored the challenges visually impaired users face when interacting with mobile applications. While the project may not have resulted in a groundbreaking innovation, it became an important learning experience that helped me better understand accessibility from a more human perspective.
More than designing interfaces, this journey taught me how visually impaired users navigate, adapt, and experience the digital world differently — and how thoughtful design can help create more inclusive experiences.
What I Wanted to Understand
What I Wanted to Understand
What I Wanted to Understand
Through this project, I focused on two main goals:
Through this project, I focused on two main goals:
Through this project, I focused on two main goals:
🧩 Evaluating the Design Approach
🧩 Evaluating the Design Approach
🧩 Evaluating the Design Approach
I wanted to explore whether the design thinking methodology could effectively help identify the real challenges faced by visually impaired users and guide the creation of more thoughtful solutions.
I wanted to explore whether the design thinking methodology could effectively help identify the real challenges faced by visually impaired users and guide the creation of more thoughtful solutions.
I wanted to explore whether the design thinking methodology could effectively help identify the real challenges faced by visually impaired users and guide the creation of more thoughtful solutions.
♿ Creating More Inclusive Experiences
♿ Creating More Inclusive Experiences
♿ Creating More Inclusive Experiences
Beyond the design process itself, I also wanted to better understand how digital product can help visually impaired users feel more included and experience technology more equally in their everyday lives
Beyond the design process itself, I also wanted to better understand how digital product can help visually impaired users feel more included and experience technology more equally in their everyday lives
Beyond the design process itself, I also wanted to better understand how digital product can help visually impaired users feel more included and experience technology more equally in their everyday lives
Discovering How Users Interact Without Vision
Discovering How Users Interact Without Vision
Discovering How Users Interact Without Vision
To better understand how visually impaired users interact with digital product, I collaborated with Komunitas Mata Hati, a disability community in Surabaya.
Though discussion, interview, and observation sessions, I explored how participant navigate mobile application using screen readers and audio-based feedback in their daily lives.
This research helped me better understand the accessibility barriers user often face, especially when interface rely to heavy on visual interaction.
To better understand how visually impaired users interact with digital product, I collaborated with Komunitas Mata Hati, a disability community in Surabaya.
Though discussion, interview, and observation sessions, I explored how participant navigate mobile application using screen readers and audio-based feedback in their daily lives.
This research helped me better understand the accessibility barriers user often face, especially when interface rely to heavy on visual interaction.
To better understand how visually impaired users interact with digital product, I collaborated with Komunitas Mata Hati, a disability community in Surabaya.
Though discussion, interview, and observation sessions, I explored how participant navigate mobile application using screen readers and audio-based feedback in their daily lives.
This research helped me better understand the accessibility barriers user often face, especially when interface rely to heavy on visual interaction.
Research Activities ✨
Research Activities ✨
Research Activities ✨
💬 Online Discussion
💬 Online Discussion
💬 Online Discussion
Conducted discussions with visually impaired participants to learn about their experiences using commonly used mobile applications.
Conducted discussions with visually impaired participants to learn about their experiences using commonly used mobile applications.
Conducted discussions with visually impaired participants to learn about their experiences using commonly used mobile applications.
🗣️ User Interview
🗣️ User Interview
🗣️ User Interview
Visited the Social Services Department to better understand the real challenges users encounter when interacting with digital products.
Visited the Social Services Department to better understand the real challenges users encounter when interacting with digital products.
Visited the Social Services Department to better understand the real challenges users encounter when interacting with digital products.
🎧 Accessibility Observation
🎧 Accessibility Observation
🎧 Accessibility Observation
Observed how participants rely on screen readers, gestures, and audio feedback to navigate applications independently.
Observed how participants rely on screen readers, gestures, and audio feedback to navigate applications independently.
Observed how participants rely on screen readers, gestures, and audio feedback to navigate applications independently.
Accessibility Benchmark 🔍
Accessibility Benchmark 🔍
Accessibility Benchmark 🔍
To better understand how assistive technology supports visually impaired users, I explored several accessibility-focused mobile applications commonly used in daily activities.
To better understand how assistive technology supports visually impaired users, I explored several accessibility-focused mobile applications commonly used in daily activities.
To better understand how assistive technology supports visually impaired users, I explored several accessibility-focused mobile applications commonly used in daily activities.
📱 Sullivan
📱 Sullivan
📱 Sullivan
Sullivan+ is an accessibility application that helps visually impaired users recognize objects, read text aloud, and identify visual information using AI-powered audio feedback.
Through this application, I learned how voice assistance and simplified interactions can help users navigate everyday situations more independently.
Sullivan+ is an accessibility application that helps visually impaired users recognize objects, read text aloud, and identify visual information using AI-powered audio feedback.
Through this application, I learned how voice assistance and simplified interactions can help users navigate everyday situations more independently.
Sullivan+ is an accessibility application that helps visually impaired users recognize objects, read text aloud, and identify visual information using AI-powered audio feedback.
Through this application, I learned how voice assistance and simplified interactions can help users navigate everyday situations more independently.
📱 Supersense
📱 Supersense
📱 Supersense
Supersense is another accessibility-focused application that helps users understand their surroundings through text recognition and audio-based guidance.
By converting visual information into spoken feedback, the application helps visually impaired users access printed information and interact with their environment more comfortably.
Supersense is another accessibility-focused application that helps users understand their surroundings through text recognition and audio-based guidance.
By converting visual information into spoken feedback, the application helps visually impaired users access printed information and interact with their environment more comfortably.
Supersense is another accessibility-focused application that helps users understand their surroundings through text recognition and audio-based guidance.
By converting visual information into spoken feedback, the application helps visually impaired users access printed information and interact with their environment more comfortably.
This 2 application didn't have offline mode
This 2 application didn't have offline mode
This 2 application didn't have offline mode
Key Accessibility Finding ⚠️
Key Accessibility Finding ⚠️
Key Accessibility Finding ⚠️
While both applications provided valuable accessibility support, I discovered a shared limitation: both relied heavily on stable internet connectivity.
Without a strong signal, several features became difficult to access or stopped functioning properly. This insight helped me realize that accessibility solutions should also consider reliability and offline usability, especially for users who depend on these tools in their daily lives.
While both applications provided valuable accessibility support, I discovered a shared limitation: both relied heavily on stable internet connectivity.
Without a strong signal, several features became difficult to access or stopped functioning properly. This insight helped me realize that accessibility solutions should also consider reliability and offline usability, especially for users who depend on these tools in their daily lives.
While both applications provided valuable accessibility support, I discovered a shared limitation: both relied heavily on stable internet connectivity.
Without a strong signal, several features became difficult to access or stopped functioning properly. This insight helped me realize that accessibility solutions should also consider reliability and offline usability, especially for users who depend on these tools in their daily lives.
Understanding Everyday Applications 📱
Understanding Everyday Applications 📱
Understanding Everyday Applications 📱
Although accessibility-focused applications exist, visually impaired users still rely heavily on mainstream applications used by everyone else.
However, many popular applications still lack proper text-to-speech optimization and accessible interaction patterns, creating friction in everyday use.
Although accessibility-focused applications exist, visually impaired users still rely heavily on mainstream applications used by everyone else.
However, many popular applications still lack proper text-to-speech optimization and accessible interaction patterns, creating friction in everyday use.
Although accessibility-focused applications exist, visually impaired users still rely heavily on mainstream applications used by everyone else.
However, many popular applications still lack proper text-to-speech optimization and accessible interaction patterns, creating friction in everyday use.
⚠️ Popular Doesn't Always Mean Accessible
⚠️ Popular Doesn't Always Mean Accessible
⚠️ Popular Doesn't Always Mean Accessible
Many widely used applications prioritize visual interfaces, but important elements such as icons and navigation labels are often not optimized for screen readers.
As a result, visually impaired users may struggle to access important information independently and still require additional assistance to navigate certain features.
Many widely used applications prioritize visual interfaces, but important elements such as icons and navigation labels are often not optimized for screen readers.
As a result, visually impaired users may struggle to access important information independently and still require additional assistance to navigate certain features.
Many widely used applications prioritize visual interfaces, but important elements such as icons and navigation labels are often not optimized for screen readers.
As a result, visually impaired users may struggle to access important information independently and still require additional assistance to navigate certain features.
✨ Accessibility Matters More Than Visual Aesthetics
✨ Accessibility Matters More Than Visual Aesthetics
✨ Accessibility Matters More Than Visual Aesthetics
During the research, I realized that visually appealing interfaces are not always the top priority for visually impaired users.
What matters more is whether the application provides reliable text-to-speech support, intuitive navigation, and accessible interactions that help users complete tasks independently and comfortably.
During the research, I realized that visually appealing interfaces are not always the top priority for visually impaired users.
What matters more is whether the application provides reliable text-to-speech support, intuitive navigation, and accessible interactions that help users complete tasks independently and comfortably.
During the research, I realized that visually appealing interfaces are not always the top priority for visually impaired users.
What matters more is whether the application provides reliable text-to-speech support, intuitive navigation, and accessible interactions that help users complete tasks independently and comfortably.
From Research to User Understanding 👥
From Research to User Understanding 👥
From Research to User Understanding 👥
After conducting interviews and accessibility research sessions, I synthesized the findings into user personas to better understand the goals, frustrations, and everyday challenges faced by visually impaired users.
These personas helped me identify recurring accessibility pain points and guided the direction of the proposed design solution.
After conducting interviews and accessibility research sessions, I synthesized the findings into user personas to better understand the goals, frustrations, and everyday challenges faced by visually impaired users.
These personas helped me identify recurring accessibility pain points and guided the direction of the proposed design solution.
After conducting interviews and accessibility research sessions, I synthesized the findings into user personas to better understand the goals, frustrations, and everyday challenges faced by visually impaired users.
These personas helped me identify recurring accessibility pain points and guided the direction of the proposed design solution.
One important thing I learned during this research is that accessibility should not separate users from everyone else.
Rather than creating an application exclusively for visually impaired users, I wanted to explore how the experience could remain inclusive and useful for a broader range of users with different navigation needs.
To better understand this perspective, I also created a secondary persona representing general users who rely on navigation applications in their daily activities.
One important thing I learned during this research is that accessibility should not separate users from everyone else.
Rather than creating an application exclusively for visually impaired users, I wanted to explore how the experience could remain inclusive and useful for a broader range of users with different navigation needs.
To better understand this perspective, I also created a secondary persona representing general users who rely on navigation applications in their daily activities.
One important thing I learned during this research is that accessibility should not separate users from everyone else.
Rather than creating an application exclusively for visually impaired users, I wanted to explore how the experience could remain inclusive and useful for a broader range of users with different navigation needs.
To better understand this perspective, I also created a secondary persona representing general users who rely on navigation applications in their daily activities.
Prioritizing Accessibility-Driven Features
Prioritizing Accessibility-Driven Features
Prioritizing Accessibility-Driven Features
Based on the research findings, I realized that the experience needed to prioritize accessibility, clarity, and ease of interaction over purely visual elements.
To translate the user insights into actionable design opportunities, I used the How Might We method to identify key accessibility challenges and explore possible solution directions.
Based on the research findings, I realized that the experience needed to prioritize accessibility, clarity, and ease of interaction over purely visual elements.
To translate the user insights into actionable design opportunities, I used the How Might We method to identify key accessibility challenges and explore possible solution directions.
Based on the research findings, I realized that the experience needed to prioritize accessibility, clarity, and ease of interaction over purely visual elements.
To translate the user insights into actionable design opportunities, I used the How Might We method to identify key accessibility challenges and explore possible solution directions.
How might we help visually impaired users navigate environment more independently?
How might we help visually impaired users navigate environment more independently?
How might we help visually impaired users navigate environment more independently?
How might we simplify object detection and environmental awareness during navigation?
How might we simplify object detection and environmental awareness during navigation?
How might we simplify object detection and environmental awareness during navigation?
How might we provide reliable accessibility support even in low-connectivity situations?
How might we provide reliable accessibility support even in low-connectivity situations?
How might we provide reliable accessibility support even in low-connectivity situations?
After exploring multiple solution opportunities through the How Might We method, I used the How, Wow, Now prioritization framework to evaluate which ideas could provide the most meaningful impact while remaining feasible to implement.
This process helped me identify features that best aligned with the users’ accessibility needs, navigation challenges, and everyday usage scenarios.
After exploring multiple solution opportunities through the How Might We method, I used the How, Wow, Now prioritization framework to evaluate which ideas could provide the most meaningful impact while remaining feasible to implement.
This process helped me identify features that best aligned with the users’ accessibility needs, navigation challenges, and everyday usage scenarios.
After exploring multiple solution opportunities through the How Might We method, I used the How, Wow, Now prioritization framework to evaluate which ideas could provide the most meaningful impact while remaining feasible to implement.
This process helped me identify features that best aligned with the users’ accessibility needs, navigation challenges, and everyday usage scenarios.
After identifying the key features and priorities, I mapped the user flow to better understand how visually impaired users would navigate the application experience from start to finish.
The flow was designed to prioritize simplicity, clear navigation, and reduced interaction friction, ensuring users could access important features more efficiently and comfortably.
After identifying the key features and priorities, I mapped the user flow to better understand how visually impaired users would navigate the application experience from start to finish.
The flow was designed to prioritize simplicity, clear navigation, and reduced interaction friction, ensuring users could access important features more efficiently and comfortably.
After identifying the key features and priorities, I mapped the user flow to better understand how visually impaired users would navigate the application experience from start to finish.
The flow was designed to prioritize simplicity, clear navigation, and reduced interaction friction, ensuring users could access important features more efficiently and comfortably.
After mapping the user journey, I created low-fidelity wireframes to explore the structure, navigation flow, and accessibility-focused interactions of the application.
The wireframing process helped me simplify the experience, prioritize essential features, and ensure users could navigate the application with minimal friction.
After mapping the user journey, I created low-fidelity wireframes to explore the structure, navigation flow, and accessibility-focused interactions of the application.
The wireframing process helped me simplify the experience, prioritize essential features, and ensure users could navigate the application with minimal friction.
After mapping the user journey, I created low-fidelity wireframes to explore the structure, navigation flow, and accessibility-focused interactions of the application.
The wireframing process helped me simplify the experience, prioritize essential features, and ensure users could navigate the application with minimal friction.
Designing for Independent Navigation
Designing for Independent Navigation
Designing for Independent Navigation
Based on the research findings and accessibility insights, I designed a mobile navigation experience focused on helping visually impaired users navigate environments more independently and comfortably.
Based on the research findings and accessibility insights, I designed a mobile navigation experience focused on helping visually impaired users navigate environments more independently and comfortably.
Based on the research findings and accessibility insights, I designed a mobile navigation experience focused on helping visually impaired users navigate environments more independently and comfortably.
📷 Object Detection
📷 Object Detection
📷 Object Detection
Inspired by smart sticks commonly used by visually impaired individuals, I designed an object detection feature that helps users identify obstacles and better understand their surroundings during navigation.
Using camera-based recognition and audio feedback, the feature aims to provide safer and more confident navigation experiences, especially when users travel independently.
Inspired by smart sticks commonly used by visually impaired individuals, I designed an object detection feature that helps users identify obstacles and better understand their surroundings during navigation.
Using camera-based recognition and audio feedback, the feature aims to provide safer and more confident navigation experiences, especially when users travel independently.
Inspired by smart sticks commonly used by visually impaired individuals, I designed an object detection feature that helps users identify obstacles and better understand their surroundings during navigation.
Using camera-based recognition and audio feedback, the feature aims to provide safer and more confident navigation experiences, especially when users travel independently.
📍 Special Reminder Add-On
📍 Special Reminder Add-On
📍 Special Reminder Add-On
This feature helps users create location-based reminders more easily and efficiently, especially during urgent situations or daily travel activities. The interaction flow was simplified with accessibility-focused input fields and reduced visual complexity, allowing users to create reminders more comfortably without relying heavily on traditional calendar layouts.
This feature helps users create location-based reminders more easily and efficiently, especially during urgent situations or daily travel activities. The interaction flow was simplified with accessibility-focused input fields and reduced visual complexity, allowing users to create reminders more comfortably without relying heavily on traditional calendar layouts.
This feature helps users create location-based reminders more easily and efficiently, especially during urgent situations or daily travel activities. The interaction flow was simplified with accessibility-focused input fields and reduced visual complexity, allowing users to create reminders more comfortably without relying heavily on traditional calendar layouts.
🏠 Optimized Home Screen
🏠 Optimized Home Screen
🏠 Optimized Home Screen
The home screen was designed to provide quick and intuitive access to navigation features for users with different accessibility needs. A prominent destination input at the top helps users start navigation more efficiently, while nearby location recommendations reduce the effort required to search for frequently visited places. The interaction pattern was inspired by familiar navigation applications such as Google Maps and Waze to create a more intuitive and recognizable experience.
The home screen was designed to provide quick and intuitive access to navigation features for users with different accessibility needs. A prominent destination input at the top helps users start navigation more efficiently, while nearby location recommendations reduce the effort required to search for frequently visited places. The interaction pattern was inspired by familiar navigation applications such as Google Maps and Waze to create a more intuitive and recognizable experience.
The home screen was designed to provide quick and intuitive access to navigation features for users with different accessibility needs. A prominent destination input at the top helps users start navigation more efficiently, while nearby location recommendations reduce the effort required to search for frequently visited places. The interaction pattern was inspired by familiar navigation applications such as Google Maps and Waze to create a more intuitive and recognizable experience.
Validating the Experience
Validating the Experience
Validating the Experience
Usability Testing & Validation 🧪
Usability Testing & Validation 🧪
Usability Testing & Validation 🧪
To evaluate the accessibility and usability of the proposed solution, I conducted moderated usability testing sessions with six visually impaired participants at Sepuluh Nopember Institute of Technology (ITS) Surabaya.
The sessions focused on understanding how users interacted with key features such as navigation, object detection, and audio guidance throughout the application flow.
To evaluate the accessibility and usability of the proposed solution, I conducted moderated usability testing sessions with six visually impaired participants at Sepuluh Nopember Institute of Technology (ITS) Surabaya.
The sessions focused on understanding how users interacted with key features such as navigation, object detection, and audio guidance throughout the application flow.
To evaluate the accessibility and usability of the proposed solution, I conducted moderated usability testing sessions with six visually impaired participants at Sepuluh Nopember Institute of Technology (ITS) Surabaya.
The sessions focused on understanding how users interacted with key features such as navigation, object detection, and audio guidance throughout the application flow.
Testing Metrics ✨
Testing Metrics ✨
Testing Metrics ✨
System Usability Scale
System Usability Scale
72.5
Single Ease Question
Single Ease Question
6.5
Key Findings 🔍
Key Findings 🔍
Key Findings 🔍
🎧 Overlapping Audio Feedback
🎧 Overlapping Audio Feedback
🎧 Overlapping Audio Feedback
Most participants reported that the screen reader and object detection feature often produced audio simultaneously, creating confusion during navigation.
This revealed the importance of better audio prioritization and interaction control within accessibility-focused experiences.
Most participants reported that the screen reader and object detection feature often produced audio simultaneously, creating confusion during navigation.
This revealed the importance of better audio prioritization and interaction control within accessibility-focused experiences.
Most participants reported that the screen reader and object detection feature often produced audio simultaneously, creating confusion during navigation.
This revealed the importance of better audio prioritization and interaction control within accessibility-focused experiences.
⚡ Slow Object Detection Response
⚡ Slow Object Detection Response
⚡ Slow Object Detection Response
Several participants experienced delays in the object detection feature, which reduced confidence while navigating environments independently.
This insight highlighted the importance of responsiveness and reliability in assistive interactions.
Several participants experienced delays in the object detection feature, which reduced confidence while navigating environments independently.
This insight highlighted the importance of responsiveness and reliability in assistive interactions.
Several participants experienced delays in the object detection feature, which reduced confidence while navigating environments independently.
This insight highlighted the importance of responsiveness and reliability in assistive interactions.
What Accessibility Taught Me
What Accessibility Taught Me
What Accessibility Taught Me
Through this project, I gained a deeper understanding of how visually impaired users interact with digital products and the accessibility challenges they face in everyday situations.
The usability testing sessions showed that users were generally able to complete key navigation tasks successfully, while also revealing several important areas for improvement, especially around audio management, interaction clarity, and response time.
More importantly, this project helped me realize that accessibility is not only about adding assistive features, but also about creating experiences that help users feel more independent, comfortable, and included when using technology.
Through this project, I gained a deeper understanding of how visually impaired users interact with digital products and the accessibility challenges they face in everyday situations.
The usability testing sessions showed that users were generally able to complete key navigation tasks successfully, while also revealing several important areas for improvement, especially around audio management, interaction clarity, and response time.
More importantly, this project helped me realize that accessibility is not only about adding assistive features, but also about creating experiences that help users feel more independent, comfortable, and included when using technology.
Through this project, I gained a deeper understanding of how visually impaired users interact with digital products and the accessibility challenges they face in everyday situations.
The usability testing sessions showed that users were generally able to complete key navigation tasks successfully, while also revealing several important areas for improvement, especially around audio management, interaction clarity, and response time.
More importantly, this project helped me realize that accessibility is not only about adding assistive features, but also about creating experiences that help users feel more independent, comfortable, and included when using technology.
Challenge & Limitation
Challenge & Limitation
Challenge & Limitation
One of the biggest challenges during development was integrating the navigation system with the maps API while maintaining the intended accessibility-focused interaction design.
As a result, some parts of the final implementation still resembled conventional navigation applications more closely than originally planned.
Another limitation was the testing process itself. Since accessibility testing tools such as Maze did not fully support screen reader simulation, usability validation had to rely heavily on direct moderated testing with visually impaired participants.
One of the biggest challenges during development was integrating the navigation system with the maps API while maintaining the intended accessibility-focused interaction design.
As a result, some parts of the final implementation still resembled conventional navigation applications more closely than originally planned.
Another limitation was the testing process itself. Since accessibility testing tools such as Maze did not fully support screen reader simulation, usability validation had to rely heavily on direct moderated testing with visually impaired participants.
One of the biggest challenges during development was integrating the navigation system with the maps API while maintaining the intended accessibility-focused interaction design.
As a result, some parts of the final implementation still resembled conventional navigation applications more closely than originally planned.
Another limitation was the testing process itself. Since accessibility testing tools such as Maze did not fully support screen reader simulation, usability validation had to rely heavily on direct moderated testing with visually impaired participants.
Future Improvement
Future Improvement
Future Improvement
Moving forward, several improvements could further enhance the experience:
Better audio prioritization between screen reader and object detection features
Faster object detection response time
More reliable offline accessibility support
Improved navigation guidance in complex environments
Moving forward, several improvements could further enhance the experience:
Better audio prioritization between screen reader and object detection features
Faster object detection response time
More reliable offline accessibility support
Improved navigation guidance in complex environments
Moving forward, several improvements could further enhance the experience:
Better audio prioritization between screen reader and object detection features
Faster object detection response time
More reliable offline accessibility support
Improved navigation guidance in complex environments
Another Design Shot
Another Design Shot
Another Design Shot
