Projects at Meta
2020 - 2026
Our research org within Reality Labs is composed of designers & prototypes, research scientists, material scientists, hardware, firmware and software engineers. We explore and develop cutting edge technologies, devices and experiences, with the goal of transferring mature concepts to product teams for further development, ultimately bringing them to millions of users.
In the past 3 years I've been focusing on creating proactive agent experiences on AI wearables with sensors beyond microphones and cameras. With the constellation of wearables, users would be able to leverage a wide range of signals to communicate their intent to AI from implicit signals like hand pose, body pose, eye and head gaze, to explicit ones like voice and gestures. And the AI can rely on not just the display but also audio and haptics to deliver info to users.
Before working on the specific wearables, I spent my first 2 years at the company creating shell experiences for future AR devices with nondeterministic inputs and outputs. The shell models focused on leveraging user behavior and environmental context at the moment to surface the correct info, and utilizing geometric understanding of the surrounding space to organize UI.
Occasionally, I designed work flows and experiences on hardware prototypes for both supervised and unsupervised data collection activities to help collect data for research and model development.
Tech at Meta
Inside Facebook Reality Labs: The next era of human-computer interaction
A 10-year vision for contextually aware, AI-powered AR interfaces that infer intent from the context people choose to share.
Tech at Meta
Inside Facebook Reality Labs: Wrist-based interaction for the next computing platform
A look at wrist-based input and how wearable signals can support interaction for future AR glasses.
Meta Newsroom
Inside Reality Labs Research: Bringing Touch to the Virtual World
Reality Labs' haptic glove research explores soft robotics, microfluidics, hand tracking, and haptic rendering for virtual touch.