NASA AR Design
For my Concepts in Human-Computer Interaction (HCI) course, I submitted an annotated bibliography exploring HCI's role in human space exploration. Following this research, my goal was to design a preliminary lunar extravehicular activity (EVA) heads-up display (HUD) system based on aggregated insights, laying the groundwork for future development.
Team & Role
Services
Date
UI Designer & Researcher
Augmented Reality
Speculative Design
May - Jun 2022
Primary Sources
Human Systems Integration of an Extravehicular Activity Space Suit Augmented Reality Display System
by Paromita MitraI
Paromita Mitra’s 2018 master’s thesis was my most valuable primary resource, offering insights into AR integration within NASA’s “Mark III” spacesuit. Mitra worked with NASA researchers to test an AR prototype, focusing on UI design and human performance metrics. The study involved 21 participants performing tasks based on NASA’s cuff checklist, currently used by astronauts aboard the ISS, to evaluate readability, usability, workload, situational awareness, and task accuracy.
Key findings revealed that green-on-black text with bar-chart symbology was the most effective for readability and usability, forming the baseline for my AR prototype’s visual design. Additionally, the thesis provided the exact cuff checklist structure needed for astronaut task instructions, which I incorporated into my heads-up display concept.
Mitra’s research serves as the foundation for both my design principles and the practical application of AR in space exploration.
2021 - 2022 NASA Spacesuit User Interface Technologies for Students (SUITS) Mission Description
by NASA
To understand current AR design principles for EVA missions, I reviewed NASA SUITS, a program challenging students to create AR spacesuit displays for the Artemis Mission. This initiative aims to integrate AR into lunar missions by enhancing navigation, terrain mapping, EVA system monitoring, and user interface functionality.
Key takeaways for my AR prototype include designing for accurate navigation (both long- and short-range), terrain sensing, continuous monitoring of vitals and cuff checklist data, and an intuitive, responsive interface.
This SUITS briefing, combined with Mitra’s research, provides a comprehensive foundation for the baseline features my AR HUD must deliver for astronauts.
Moon Buddy Team Working with NASA on Spaceuits for Lunar Exploration
by Aaron Aupperlee
To expand my perspective, I studied Carnegie Mellon University’s “Moon Buddy,” an AR interface submitted for the 2022 NASA SUITS challenge. Designed to meet NASA’s requirements for lunar EVA missions, the system incorporated insights from Dr. Jay Apt, a former astronaut who shared his firsthand experience with the physical constraints of spacesuits.
Dr. Apt emphasized the challenges of using hands in bulky gloves, likening it to squeezing a gallon of milk. In response, the team implemented voice controls, enabling astronauts to interact with the AR system hands-free.
This innovative approach highlighted alternative methods of communication for AR systems, broadening my understanding beyond traditional touchscreen-based controls for managing the HUD.
Justification Source
Voice Control
My design includes voice-activated inputs, enabling astronauts to use fixed commands to trigger programmed capabilities and ultimately keep their hands free.
Justification Source
User Interface
The UI features a NASA cuff checklist in green text on a semi-transparent black background, left-justified for optimal readability by English-reading users.
Justification Source
EVA System State
My design displays vital metrics like UTC time, EVA time, battery life, water levels, and oxygen levels, based on Mitra's highly readable UI #2 from her master’s thesis study.
Justification Source
Terrain Navigation
Features navigational instructions, including travel direction and object distances, displayed in the same legible green tint for consistency across the UI.
Further Justifications
In addition to the outlined specifications, I incorporated a few personal design choices.
First, I left-justified all information to align with the left-to-right reading habits of English-speaking American astronauts, ensuring the HUD preserves a large field of view. For other nationalities with right-to-left reading systems, the HUD could be mirrored to the right margins.
Second, lacking specific guidance on typeface for AR, I chose Times New Roman for its proven legibility and versatility across mediums.
Lastly, I placed the mockup inside the astronaut’s helmet, including a raised hand against the lunar landscape to convey scale and readability. To ensure accuracy, I used my own hand as a reference, matching its proportions to the mockup for optimal legibility within the astronaut’s field of view.
