Navigating text entry without relying on a traditional keyboard is a persistent puzzle in the XR headset industry. Tackling this, researchers have meticulously cataloged a variety of text entry methods, aiming to break down their advantages and drawbacks. The goal? To pave the way for fresh innovations in this evolving space by making this extensive catalog openly accessible.
[Image of Max Di Luca]: Max Di Luca, an accomplished figure in this field, is a driving force behind this research. Heading the VR Lab at the University of Birmingham, UK, he holds distinguished positions in both psychology and computer science. Formerly at Meta, he made significant strides in developing hand inputs and haptics for virtual reality. Recently, his work on Android XR interaction frameworks was celebrated with accolades at the ACM SIGCHI 2025 awards, underscoring a significant industry-academia partnership.
In the ever-advancing world of immersive experiences, the issue of efficient text entry stands as a major hurdle for seamless interaction in virtual and augmented reality. From drafting emails in virtual spaces to logging in and connecting with others in the metaverse, the ability to enter text quickly and efficiently is paramount to using extended reality (XR) applications effectively.
To bridge this gap, our team at the VR Lab at the University of Birmingham in collaboration with several esteemed universities and Google, crafted the XR TEXT Trove. This detailed research project documents over 170 unique text entry methods developed for XR, offering a structured repository of techniques. It includes a filtering system highlighting the pros and cons of these methods, cultivated from both academic research and industry practices.
Classifying these techniques involves 32 distinct codes, covering 13 interaction attributes like Input Device and Haptic Feedback Modality, alongside 14 performance metrics, for example, Words Per Minute (WPM) and Total Error Rate (TER). Such an in-depth overview points to the current state of XR text input technologies.
From our research, a few critical insights emerge. Text input speed is naturally curbed by the number of input devices—be those fingers, hand controllers, or other interfaces. Only when utilizing multiple fingers can users achieve speeds comparable to traditional keyboard typing. Our observations illustrate that each additional input element (like a finger) typically enhances typing speed by roughly 5 WPM.
Visual aids within the study showcase how employing multiple fingers and various input devices correlates with different words-per-minute outcomes. Essentially, each technique examined provides unique insights into the XR text entry landscape.
Moreover, we found that haptic feedback, tangible external surfaces, and focusing on fingertip visualization boost typing efficiency. Typing on a solid surface rather than mid-air not only feels more natural but also reduces fatigue, easing issues like Gorilla Arm Syndrome through lesser muscle exertion.
Despite these breakthroughs, nothing has outright surpassed the traditional keyboard in text entry speed, likely due to its learning complexity. To outpace PC typing in VR, the field might explore reducing finger travel on a multi-finger keyboard with AI and machine learning—akin to how "swipe typing" revolutionized smartphone input.
The XR Text Trove thus marks a pivotal step toward deeper understanding and improvement of text input in virtual environments. It’s a resource designed for both researchers and developers to push forward more user-friendly and efficient text entry solutions in the XR arena.
Our published paper outlines the prospective benefits for the XR community: "In support of XR research and design, we have made the database and its tools accessible via the XR TEXT Trove website." This work is poised to be showcased at the upcoming ACM CHI conference in Yokohama, Japan, a testament to its significance.
Many of our team also contributed to the Locomotion Vault, another cataloging effort for VR locomotion techniques, guiding researchers and designers in refining various immersive methods.
