Fetching the paper…

Reading the bibliography…

2020

HoloLens 2 Research Mode as a Tool for Computer Vision Research

Ungureanu, Dorin, Bogo, Federica, Galliani, Silvano et al.

Original
PDF
Post on X

Understand

Mixed reality headsets, such as the Microsoft HoloLens 2, are powerful sensing devices with integrated compute capabilities, which makes it an ideal platform for computer vision research.

In this technical report, we present HoloLens 2 Research Mode, an API and a set of tools enabling access to the raw sensor streams.
We provide an overview of the API and explain how it can be used to build mixed reality applications based on processing sensor data.
We also show how to combine the Research Mode sensor data with the built-in eye and hand tracking capabilities provided by HoloLens 2.

HoloLens 2 Research Mode as a Tool for Computer Vision Research · Around

Built on

Open3D: A modern library for 3D data processing
Original
Qian-Yi Zhou, Jaesik Park, and Vladlen Koltun · 2018
Earlier work this paper cites.
BAD SLAM: Bundle adjusted direct RGB-D SLAM
Thomas Schöps, Torsten Sattler, and Marc Pollefeys · 2019
Earlier work this paper cites.
https://docs.microsoft.com/en-us/windows/mixed-reality/cvpr-2019
Computer Vision Applications for Mixed Reality Headsets Workshop at CVPR 2019 · 2020
Earlier work this paper cites.

Similar

https://www.microsoft.com/en-us/hololens/hardware
Microsoft HoloLens2 · 2020
Cited alongside, same era.
https://github.com/microsoft/HoloLens2ForCV
Microsoft HoloLens2ForCV GitHub repository · 2020
Cited alongside, same era.
https://github.com/microsoft/HoloLensForCV
Microsoft HoloLensForCV GitHub repository · 2020
Cited alongside, same era.

Then

https://opencv.org/
OpenCV library · 2020
Closest in time.
https://docs.microsoft.com/en-us/uwp/api/windows.media.capture.frames?view=winrt-19041
Windows Media APIs · 2020
Closest in time.
https://docs.microsoft.com/en-us/uwp/api/windows.perception.spatial?view=winrt-19041
Windows Perception APIs · 2020
Closest in time.

Beyond the bibliography

alphaXiv searches the wider corpus for related work and actual follow-ups.

Open on alphaXiv

alphaXiv is searching for related work…