[2008.11239] HoloLens 2 Research Mode as a Tool for Computer Vision Researchopen searchopen navigation menucontact arXivsubscribe to arXiv mailings

Mixed reality headsets, such as the Microsoft HoloLens 2, are powerful sensing devices with integrated compute capabilities, which makes it an ideal platform for computer vision research. In this technical report, we present HoloLens 2 Research Mode, an API and a set of tools enabling access to the raw sensor streams. We provide an overview of the API and explain how it can be used to build mixed reality applications based on processing sensor data. We also show how to combine the Research Mode sensor data with the built-in eye and hand tracking capabilities provided by HoloLens 2. By releasing the Research Mode API and a set of open-source tools, we aim to foster further research in the fields of computer vision as well as robotics and encourage contributions from the research community.

4 mentions: @hiro6391@masafumi@CSarXiv@uzkt
Date: 2020/08/27 11:21

Referring Tweets

@uzkt MicrosoftがCVやロボティクスの研究を促進するためにHoloLens2のリサーチモードに関する論文を出してる。ツールはOSSでリリースするらしい。ただ、まだツールにはアクセスできなそう。活用例としてTSDFボリューム統合とSLAMが挙げられてる t.co/I5MYPhOrY6 t.co/sV1THuVmnA
@masafumi 論文が出ていたHoloLens 2のCompute Vision研究に向けたリサーチモードの話の記事が公開されていますね t.co/SzbSWPXVpM t.co/p0D0QQNN9H
@hiro6391 HoloLens 2 の Research Mode に関する論文が出ている 画像と IMU 情報がとれるらしい HoloLens 2 Research Mode as a Tool for Computer Vision Research t.co/Nr12rrgfrw HoloLens2ForCV なるリポジトリが引用されているけどまだアクセスできない

Related Entries

Read more [2002.05227] Variational Autoencoders with Riemannian Brownian Motion Priorscontact arXivarXiv Twitt...
0 users, 1 mentions 2020/02/15 00:51
Read more [2003.03397] Dropout: Explicit Forms and Capacity Controlcontact arXivarXiv Twitter
0 users, 1 mentions 2020/03/11 00:52
Read more [2004.11419] End-to-end speech-to-dialog-act recognitionopen searchopen navigation menucontact arXiv...
0 users, 1 mentions 2020/05/02 14:21
Read more [2006.10135] M2Net: Multi-modal Multi-channel Network for Overall Survival Time Prediction of Brain ...
0 users, 1 mentions 2020/06/19 18:52
Read more [2007.09200] Neural Networks with Recurrent Generative Feedbackopen searchopen navigation menucontac...
0 users, 2 mentions 2020/07/22 21:51