Meta Co.: Augmented Reality Platform
The Context
A zero-to-one AR startup building an original holographic HMD and cloud-based ecosystem, charting largely unknown territory.
What I Led
- Platform design and UX architecture for the AR ecosystem, built on custom APIs and SDK, spanning native and third-party apps
- Authored the AR Human Interface Guidelines
- Touchless interaction models using hand/body gestures, gaze/eye tracking, voice, and NUI
- Rapid prototyping sprints and AR usability research and testing
- Specs for conversational UI, holographic app design, and features
- Out-of-box experience for the Meta 2 HMD launch
Collaboration
Worked closely with computer vision and SLAM engineers on a small, pioneering team.
Augmented Reality Web Panels
Augmented Reality Wall-Based Content Panels
Augmented Reality Web Panels. Early AR web panel, exploring the familiar and streamlined iOS mobile form factor. Challenges: optics fidelity, interaction fidelity (hands recognition), latency, user proprioception, and so many more...
Meta 2 HMD
Meta 1 HMD. Rigging the HMD cables for a photoshoot.
Calibration. QR code calibration, the 'old fashioned way.' Not elegant but usually reliable. Early stages of augmented reality.
HMD Optics. View through the HMD, early stage development of optics.
User Flows for Augmented Reality Apps.
Working through user flow and usability of holographic interactions.
HMD Roadmapping.
Fulfillment System Flow.
Wireframes for App Launch Screens. I spec'd the low-poly art aesthetic. Gave the 3D artists the option to offer additional ideas on approach but they both liked this direction and applied it really well in their animations:
Holographic App Launch Screen. Animation by Jayse Hansen.
Holographic App Launch Screen. Animation by Lynwood Montgomery.
Wireframe + User Flow. "Wireflows" were the most applicable schematic solution for these very first prototypical apps. These first two apps launching along with the publication of the SKD were very much a "hello world," demonstrating this new technology but not yet pushing the limits.
SDK Wireframing and Usability
'Paper Prototyping' for Augmented Reality.
Testing hardware.
Frog Design created the base HMD unit. I was asked to consider the usability, size and placement of several additional buttons along both sides of the unit." loading="lazy">HMD: Sketching. Frog Design created the base HMD unit. I was asked to consider the usability, size and placement of several additional buttons along both sides of the unit.
HMD: Button Research.
HMD: Button Functionality Proposal
Steve Mann, Stefano Baldassi, Ray Lo and Jayse Hansen." loading="lazy">
Meta HQ, Portola Valley, CA