Skip to content

Conversation

@argo-1
Copy link

@argo-1 argo-1 commented Oct 17, 2019

Research mode Sensor Streamer using Websockets and Background Tasks
Tools/StreamerVLC prepared to register and trigger an extended duration out-of-process sensor streaming background task on the Microsoft HoloLens, using HoloLensForCV.

Send sensor frames from the eight research mode sensors, or the rgb camera (to be tested), through a background task. Stream synchronised stereo pairs from the front left and right visible light cameras, using JSON, through websockets.

Send Robot Operating System (ROS) messages (or services - to be added) as JSON strings using a ROSBridge websocket-server ROS node.

It is possible to use the ROSBridge websocket server, additionally, to send data to a Unity app using ROS# https://github.com/siemens/ros-sharp . One can use a Python or C++ ROS node to subscribe to and process sensor data and send messages to a foreground Unity HoloLens app (, or any non-Unity app using websockets.)

The foreground StreamerVLC can be suspended on the HoloLens without hindering the background streamer, allowing an immersive app developed in Unity to run simultaneously, while utilising the research mode sensor streams.

@msftclas
Copy link

msftclas commented Oct 17, 2019

CLA assistant check
All CLA requirements met.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants