Skip to content

dataTimeSpace/Vuforia-Spatial-Toolbox-Virtualizer

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Vuforia Spatial Toolbox Virtualizer

Read First

The Vuforia Spatial Toolbox and Vuforia Spatial Edge Server make up a shared research platform for exploring spatial computing as a community. This research platform is not an out of the box production-ready enterprise solution. Please read the MPL 2.0 license before use.

Join the conversations in our discourse forum if you have questions, ideas, want to collaborate, or to just say hi.

Prerequisites

Note that you must own 1-6 Microsoft Azure Kinect cameras to use this software.

Install Git and/or Github Desktop. Install Unity 2017.4.10f1 from the Unity download archive. Install Azure Kinect Development Kit v1.3.0 and Azure Kinect Body Tracking SDK v0.9.4

If you encounter the error DllNotFoundException it will be necessary to also install Visual Studio Code 2017 and 2019 with support for C++ development. This covers missing dependencies on freshly installed copies of Windows.

Copying dependencies with checkout.sh

Run this repository's script checkout.sh in Git Bash. This generally looks like the following:

cd Documents/GitHub/repos/Virtualizer
./checkout.sh

This should copy some dlls from the Azure Kinect SDKs, you should have some new dll files in the same directory as checkout.sh. The whole process should look like this:

checkout.sh run

Adding OpenCVForUnity

Next, it's time to add OpenCVForUnity v2.4.2 to the project. This project is available on its website. For testing purposes the free trial is enough. Add this asset through Unity's Assets > Import package > Custom package menu.

Starting the project in Unity

Open the project in Unity. It should look like this:

open in unity

If the start scene doesn't open by default, open it here:

start scene location

Clicking the run button should pop up with uncalibrated cameras. To get an initial calibration click the Autocalibrate button then manually refine the camera positions if desired.

autocalibrate button

Click "Save Calibration" to save this new calibration.

save calibration button

Connecting to an edge server

Download and setup the edge server as described in the tutorial. You should have a working edge server with a normal directory structure:

edge server layout

Stop the server if it's been started.

Download the remote operator from its repository and unpack its directory in your edge server's addon directory. It should look like this:

edge server addons

Starting the edge server

Stop the Unity scene if it's currently running. Start the server with npm start:

npm start

With the server running and logging messages to the console, start the Unity project. It should connect to the edge server. Note the 'name function has been called with: station' messages below

logging after connection

Viewing in browser

Finally, open localhost:8081 and select your local IP from the top left menu to see the Virtualizer in action.

browser view

About

Kinect-based reality zone viewer

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • C# 96.4%
  • ShaderLab 3.5%
  • Shell 0.1%