Skip to content
This repository was archived by the owner on Jul 19, 2024. It is now read-only.

Update Spectator View#271

Merged
keveleigh merged 57 commits intomicrosoft:masterfrom
fieldsJacksonG:master
Jun 14, 2018
Merged

Update Spectator View#271
keveleigh merged 57 commits intomicrosoft:masterfrom
fieldsJacksonG:master

Conversation

@fieldsJacksonG
Copy link
Contributor

@fieldsJacksonG fieldsJacksonG commented May 15, 2018

  1. Remove dependency on MRTK to make integration with existing projects easier.
  2. Improve pose correlation to color frames.
  3. New standalone app for the SV HoloLens (SpectatorViewPoseProvider) that sends poses and spatial mapping information to the compositor.
  4. Simplified sample networking stack.
  5. Decoupled SV logic from networking logic.
  6. Shader updates.

Fixes: #179, fixes #213, fixes #218, fixes #231, fixes #239, fixes #262

…g when moving the camera.

Remove cached IP in Unity project
-Clock synchronization and cached poses and color frames to find closest match.
-Buffered texture fetches to improve video recording performance

Update network to not lock when finding pose.

Update SpectatorViewManager to accept a frame offset to account for variable latency in capture pipeline.
Default to 3 frames, which seems to be BlackMagic's HDMI capture latency.

Lifecycle bug fixes - all state should reset when we stop play-mode.
Photos are now using sRGB color space, previously were too bright.
Use frame-based timestamp to normalize timestamp to frame rate - not doing this prevented OpenCV captures from recording correctly.
Remove AdditionalTimeOffsetSeconds from SpectatorViewManager to reduce complexity/ confusion since FrameOffset does the same thing.
- Use latest IFrameProvider interface
- Set output texture
- force opaque frame buffers for non-yuv capture devices.
Update Elgato frame capture to work more reliably when calibrating.
Allow for debug calibration builds
…hile) x64 only, and SV DLLs now only run in the Editor.

Add #if UNITY_EDITOR wrappers to SV code to ensure we only run in the editor.
currently anchors are not being shared successfully
Once anchors are shared within Unity apps, will intercept in SV PoseProvider
…import the shared anchor.

Update to 2017.4 since 2017.3 was not always sharing anchors successfully.
Currently the anchor owner must have already started it's server, and the pose provider must know the IP and port.
Populate IPs from SharingToSVAdapter
… frequently.

Send anchor name and force-reconnect flag to pose provider to check if a new anchor needs to be imported.
Only send message to pose provider if an anchor needs to be reestablished.
… a new HoloLens joins.

The anchor name and IP will both be sent to Unity to distribute to the SV device.
NOTE: This is for the simple sharing presented in this demo project.  A more robust sharing solution will keep track of the anchor owner and distribute to all clients.
Temp/*

# dlls
Assets/Addons/SpectatorViewRig/Plugins/WSA/x64/*
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No more WSA plugin?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nope - SV used to require building and deploying the app to the SV HoloLens, now it interfaces with SpectatorViewPoseProvider.

keveleigh
keveleigh previously approved these changes Jun 8, 2018
@keveleigh
Copy link
Contributor

@fieldsJacksonG There are merge conflicts.

@Ybalrid
Copy link
Contributor

Ybalrid commented Jun 11, 2018

Hey, separating the network code from the logic will be extremely useful. And the fact of not having to deploy a build of the app to the headset fastened to the camera rig will be really helpful

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.