Meta Co. – Augmented Reality

Role
Product Design Director
Domain
Augmented Reality
Client
Meta Co.

In this “Zero to 1” startup, I established Meta’s first Product UX design group, melding 3D prototyping R&D, 2D and UX disciplines. Led platform design, created UX architecture for augmented reality cloud-based ecosystem based on custom APIs and SDK framework; comprised of native & third-party apps for an original HMD powering holographic spatial experiences. Authored AR HIG & drove research and prototyping of AR–UX usability best practices. 
Authored detailed specs on conversational UI, holograph-application design & usability (incl. user testing), features & functionality, defined OOBE experience for Meta 2 HMD release. Scoped & led UX rapid prototyping sprints, created touchless interaction models while leveraging 
HCI principles based on device inputs: hand/body gestures, gaze/eye-tracking, voice-based and NUI 
interfaces. Worked closely with computer vision & SLAM engineers & a small team charting a lot of unknown territory. Collaborated with C-suite on product road-mapping and implementation.

Meta
Meta
Augmented Reality Web Panels
Augmented Reality Web Panels
Augmented Reality Wall-Based Content Panels
Augmented Reality Wall-Based Content Panels
Augmented Reality Web Panels. Early AR web panel, exploring the familiar and streamlined iOS mobile form factor. Challenges: optics fidelity, interaction fidelity (hands recognition), latency, user proprioception, and so many more...
Augmented Reality Web Panels. Early AR web panel, exploring the familiar and streamlined iOS mobile form factor. Challenges: optics fidelity, interaction fidelity (hands recognition), latency, user proprioception, and so many more...
Meta 2 HMD
Meta 2 HMD
Meta 1 HMD. Rigging the HMD cables for a photoshoot.
Meta 1 HMD. Rigging the HMD cables for a photoshoot.
Calibration. QR code calibration, the 'old fashioned way.' Not elegant but usually reliable. Early stages of augmented reality.
Calibration. QR code calibration, the 'old fashioned way.' Not elegant but usually reliable. Early stages of augmented reality.
HMD Optics. View through the HMD, early stage development of optics.
HMD Optics. View through the HMD, early stage development of optics.
User Flows for Augmented Reality Apps.
User Flows for Augmented Reality Apps.
Meta Co. – Augmented Reality
Meta Co. – Augmented Reality
Working through user flow and usability of holographic interactions.
Working through user flow and usability of holographic interactions.
Meta Co. – Augmented Reality
HMD Roadmapping.
HMD Roadmapping.
Fulfillment System Flow.
Fulfillment System Flow.
Wireframes for App Launch Screens. I spec'd the low-poly art aesthetic. Gave the 3D artists the option to offer additional ideas on approach but they both liked this direction and applied it really well in their animations:
Wireframes for App Launch Screens. I spec'd the low-poly art aesthetic. Gave the 3D artists the option to offer additional ideas on approach but they both liked this direction and applied it really well in their animations:
Holographic App Launch Screen. Animation by Jayse Hansen.
Holographic App Launch Screen. Animation by Jayse Hansen.
Holographic App Launch Screen. Animation by Lynwood Montgomery.
Holographic App Launch Screen. Animation by Lynwood Montgomery.
Wireframe + User Flow.
Wireframe + User Flow. "Wireflows" were the most applicable schematic solution for these very first prototypical apps. These first two apps launching along with the publication of the SKD were very much a "hello world," demonstrating this new technology but not yet pushing the limits.
Meta Co. – Augmented Reality
Meta Co. – Augmented Reality
SDK Wireframing and Usability
SDK Wireframing and Usability
'Paper Prototyping' for Augmented Reality.
'Paper Prototyping' for Augmented Reality.
Testing hardware.
Testing hardware.
HMD: Sketching. <a href=Frog Design created the base HMD unit. I was asked to consider the usability, size and placement of several additional buttons along both sides of the unit." loading="lazy">
HMD: Sketching. Frog Design created the base HMD unit. I was asked to consider the usability, size and placement of several additional buttons along both sides of the unit.
HMD: Button Research.
HMD: Button Research.
HMD: Button Functionality Proposal
HMD: Button Functionality Proposal
Crazy shenanigans with <a href=Steve Mann, Stefano Baldassi, Ray Lo and Jayse Hansen." loading="lazy">
Crazy shenanigans with Steve Mann, Stefano Baldassi, Ray Lo and Jayse Hansen.
Meta HQ, Portola Valley, CA
Meta HQ, Portola Valley, CA
← ALL PROJECTS