With the AR MultiPendulum app, I created the world’s first AR headset experience that does not rely on expensive specialized hardware. Using Google Cardboard, a standard iPhone, and video footage from the phone’s camera, the app creates an AR headset experience by rendering the user’s surroundings in VR. Augmented reality (AR) is a technology that overlays virtual objects over the real world. For years, AR experiences have been available on smartphones through handheld AR apps. In 2016, Pokemon Go popularized AR, overlaying virtual characters on a map of the world. Beyond that, AR has only played a minor role in the average person’s life, being used for a few occasional tasks such as measuring objects or testing out furniture. By interacting with detailed 3D models of the human body, surgeons can run through the steps of surgery and learn from mistakes in an environment that will not endanger a patient’s life.
Features
- Xcode 13 or higher is required for working with ARHeadsetKit
- iOS device running at least iOS 14
- Learning ARHeadsetKit involves following tutorials hosted in Xcode
- Set up ARHeadsetKit as a Swift package
- Overhauls multiple iOS and macOS frameworks with high-level wrappers that maximize performance
- Easy-to-render AR objects and a CPU ray tracing API