Skip to content

Latest commit

 

History

History
155 lines (108 loc) · 4.6 KB

README.md

File metadata and controls

155 lines (108 loc) · 4.6 KB
Raw

KinectPV2

Kinect v2 library for Processing

Version 0.7.8

Library is curretly on develop with the Windows SDK Version 1409 (9/16/2014)

Library for Mac check out the OpenKinect-for-Processing library.

####Requirements

  • A Kinect for Windows v2 Device (K4W2).
  • Kinect SDK v2
  • 64bit computer with a dedicated USB 3.0.
  • Windows 10, 8, 8.1
  • Processing 3.0
  • Update your latest video card driver.
  • Install DirectX 11.

Reference and tutorial

Webpage tutorial with a couple of useful examples.

Install for Processing 3.0

  • Install the Kinect for Windows SDK v2
    • Install the library using Processing Contributed Library Manager
    • Manual install, download the latest KinectPV2 version from the releases tab, and copy the KinectPV2 folder into your processing libraries sketch folder.
  • Enjoy

For Processing 2.2.1 please use the KinectPV2 0.7.2 version.

Examples

  • TestImages, Test all Frames/Images for the Kinect.
  • SkeletonMaskDepth, Skeleton positions are mapped to match the depth and body index frames.
  • SkeletonColor, Skeleton is mapped to match the color frame.
  • Skeleton3d, 3d Skeleton example needs love.
  • SimpleFaceTracking, simple face tracking with mode detection.
  • PointCloudOGL, Point cloud depth render using openGL and shaders.
  • PointCloudDepth, point cloud in a single 2d Image and threshold example.
  • PointCloudColor, Point cloud in color, using openGL and shaders.
  • MaskTest, Body Index test, and body index with depth.
  • Mask_findUsers, find number of users base on body index information.
  • MapDepthToColor, depth to color mapping, depth frame is aligned with color frame.
  • HDFaceVertex, Face vertices are match with the color frame.
  • HDColor, 1920 x 1080 RGB frame.
  • DepthTest, Depth test with raw depth data.
  • CoordinateMapperRGBDepth, example broken, check 0.7.2 version.
  • RecordPointCloud, simple OBJ recording of the point cloud positions.
  • OpenCV examples:
    • Live Capture App
    • Find Contours with depth or bodyIndex

Build

To build the KinectPV2 library from source code, look at the Build_libs folder

  • KinectPV2_vc2012, builds the .dll library with JNI code.
  • KinectPV2_Eclipse, builds the .jar library for processing.

Know issues

  • Missing "msvcp110.dll", or "Kinect20.Face.dll: Can't find dependent libraries on thread"
  • Problems with the video, update your video card driver and install DirectX 11.

Todo

Simple Device

To include the library into a processing sketch you just need to import it and initialize it.

import KinectPV2.*;
KinectPV2 kinect;

void setup() {
  kinect = new KinectPV2(this);
  //Start up methods go here
  kinect.init();
}

Images

To obtain the color Image, depth Image, infrared Image, bodyIndex Image and long Exposure Image as a PImage you need to active with the following method

 void enableColorImg(boolean toggle);
 void enableDepthImg(boolean toggle);
 void enableInfraredImg(boolean toggle);
 void enableBodyTrackImg(boolean toggle);
 void enableInfraredLongExposureImg(boolean toggle);
 
 PImage getColorImage();
 PImage getDepthImage();
 PImage getInfraredImage();
 PImage getBodyTrackImage();
 PImage getInfraredLongExposureImage();

just initialize in the setup()

  kinect = new KinectPV2(this);
  kinect.enableColorImg(true);
  kinect.init();

get the PImage in the draw()

PImage imgC = kinect.getColorImage();
image(imgC, 0, 0);

Raw Data is only available for the color, depth ad bodytrack frames/images. Once the frames are activated just call them.

  //raw Data int valeus from [0 - 4500]
  int [] rawData = kinect.getRawDepthData();
  
  //values for [0 - 256] strip
  int [] rawData256 = kinect.getRawDepth256Data();
  
  //raw body data 0-6 users 255 nothing
  int [] rawData = kinect.getRawBodyTrack();
  
  //unpacket color values
  int [] colorRaw = kinect.getRawColor();

License

MIT License http://en.wikipedia.org/wiki/MIT_License