Here is an even better video, now with the map reconstruction running in realtime from the data it's receiving from the Quest. To "transfer" the tracking from the Quest onto the localization service it's using the pose/image pairs and rebuild the tracking with it's own features. Since the Quest has a really good tracking system we kind of "distill" that down into our own map. The localization service exposes this tracking system over a REST endpoint, so another device ( which can be something different like the Viture Beast glasses ) can then request to be localized within that map by sending just the image it sees.

Woohoo! Some progress in localizing the Viture Beast camera against the Meta Quest tracking. The Viture is just the placeholder device for now, the goal is to allow colocation between any device Quest -> Quest, Quest -> Galaxy XR, XREAL/Viture -> Quest, etc. This is done visually and automatically via SLAM, not by manually aligning the coordinate systems.