We’ve been working on something new here at Occipital called Bridge Engine. Some of you have already seen our teaser videos on YouTube of Bridge Engine capabilities (and we noticed the discussion on the Forums). So we’d like to share a few more details about the features of Bridge Engine.
Bridge Engine is a dynamic mixed reality software framework & authoring tool that enables compelling, room-scale augmented reality and virtual reality experiences applicable to various industries and physical environments. You can intersperse 3D assets into your environment, or bring your environment into a completely virtual world. Assets and animations are managed through Xcode, while pinning assets and interactions into your unique environment happen from your device. Bridge Engine includes the following features:
The Bridge Engine excels at what is commonly referred to as relocalization. When a Bridge Engine based application starts, simply pointing the Structure Sensor enabled device at a pre-captured scene quickly and automatically synchronizes the 3D scene’s virtual camera in relationship to the user’s position in the real world. This is essential for displaying your augmented reality models with high visual quality and accuracy.
###6-DoF Tracking With Depth & Color
A pre-scan of your environment using Structure Sensor provides the 3D mesh and color data that enables real-time, high-accuracy camera tracking. Tracking failure caused by blur, sudden motion and occlusion are minimized. In addition, the RGB camera can be blinded while the system will continue to track against your mesh. As the camera view returns from being blinded, your 3D assets will recover seamlessly and display on screen with minimal delay.
###Tight Low-Latency Coupling Between Vision and Graphics
The engine schedules color, depth and IMU tracking and rendering for mono and stereo. It also manages real-world occlusions with virtual objects as they are rendered into your environment scene. This includes components from the SceneKit, such as physics, particle effects and shadows on virtual and real objects.
###Extension of Structure Sensor SDK
Bridge Engine lives on top of the iOS Structure SDK while using advanced functionality of SceneKit and OpenGL ES.
###Planning Mobile VR Support Out-of-the-box
Initial Beta included stereo settings for the Homido Mini. Let us know which mobile HMD kits you’d like us to include settings for.
The participating companies include:
- Ryan Measel (@ryan2) with Fantasmo Studios
- Gabe Paez, Eric Hackborn, Taylor Libonati with WILD
- Michael Dykier (@mdykier) with Grisly Manor Studios
- Michael Balzer (@mebalzer) with NEOD.io
- Aaron Hilton (@otri) with Conquer Mobile
- Markus Meixner with ViewAR
- Ben Hesson with Morph3D
- Sam Murley (@sam_murley) with Atmo
- John Benton (@john8enton) with NYU’s Virtual Reality Lab
If you’re interested in getting early access to the pre-release version of the Bridge Engine Beta please send me a DM via the Forums. Access is limited, so please follow the requirements below.
- Must have a Structure Sensor
- Comfortable with iOS Xcode/SceneKit
- Proposed application to build with Bridge Engine, and proposed launch date (if applicable)
- Willing to share information/videos about your Bridge Engine developments with the community - we’d like to share these at events and promote on social media
- iOS device with A8 chip or newer for optimal Bridge Engine performance. (Including iPad Air 2, Mini 4, iPhone 6s)
- Signed Occipital NDA (our API is still pre-release and confidential)
We hope you’re as excited about the possibilities of Bridge Engine as we are. Live demos at the Consumer Electronics Show, Game Developers Conference, Autodesk’s REAL 2016, San Francisco VR Meetup events, Super Ventures Launch Party and the San Francisco VR Hackathon have garnered a very positive reception. We will continue to improve Bridge Engine and have progressively more public releases. While there is no announcement at this time about a completely public launch of Bridge Engine, we’re committed to ensure that all Beta participants are able to launch their creations on their schedules.
Developer Program Manager
“Capture The World In 3D”
Occipital HQ YouTube Channel Videos on Bridge Engine
Occipital at REAL 2016 - The Augmented Worksite
Example maintenance instruction scenario using augmented reality
Occipital Bridge Engine Beta - Next-generation Mixed Reality
Debug view showing high accuracy, robust tracking and relocalization
Bridge Engine Demo: Occipital at CES 2016
Original announcement running on current-gen iOS device, applied occlusion and physics with real objects
Bridge Engine Private Beta Demos Compilation Video
Demonstrations of Bridge Engine created by participating companies of the private beta