In an era where Mixed Reality (MR) and Augmented Reality (AR) systems are redefining digital interaction, one critical challenge remains: how to sense precise and consistent touch on physical surfaces. While head-mounted displays (HMDs) and MR systems excel in spatial tracking and gesture recognition, they often fall short in detecting nuanced input like the moment of contact or applied pressure. pressAR addresses this gap with a novel, vision-based sensing system that uses standard cameras to detect touch and force with unparalleled accuracy—all without requiring additional instrumentation of the user or environment.
Touch sensing in MR systems is complex. Existing approaches rely heavily on instrumentation, such as capacitive surfaces, mechanical sensors, or wearables. These methods are often impractical for large-scale deployment due to cost, maintenance, or compatibility issues.
Key challenges in touch sensing for MR include:
pressAR solves these challenges by leveraging the ubiquitous presence of IR and RGB cameras in MR devices to deliver robust, scalable, and accurate touch and force sensing.
pressAR combines imaging technology with advanced signal processing to sense touch and applied force on any surface. The system operates with three key components:
By avoiding physical instrumentation, pressAR extends the interaction capabilities of MR systems without compromising on portability or usability.
pressAR unlocks new possibilities in Mixed Reality, enabling seamless interaction across diverse scenarios:
Developing pressAR required overcoming key technical hurdles:
These challenges were met through a combination of high-resolution imaging, real-time signal processing, and machine learning algorithms tailored to MR interaction.
pressAR bridges the gap between the physical and digital worlds, transforming any surface into an interactive space. By providing reliable, scalable, and precise touch and force sensing, it redefines what’s possible in MR systems. From gaming to industrial applications, pressAR demonstrates how thoughtful engineering can unlock new dimensions of interaction.
In a world where AR and MR interfaces continue to expand, pressAR offers a glimpse into the future: a reality where every surface can become a tool for precise, seamless, and intuitive interaction.