v0.10.1

In this version, pre-built packages are distributed for the first time (to know how it's built, see https://github.com/homuler/MediaPipeUnityPlugin/blob/v0.10.1/.github/workflows/package.yml).
GitHub Actions workflows are also set up, so once you fork this repository, I think you can build a package with your favorite options.

Features

objectron: Set confidence parameters from the UI (#605)

Bug Fixes

• docker build freezes when building a Docker Windows image (#631)
• OpenCV paths are wrong on macOS (#592)
• Some tests fail when built with GPU disabled (#634)
• Some tests fail on Windows (#644)

Build

• Upgrade the Bazel version to 5.2.0 (#623)
  • Now build fails with bazel 5.0.0
• Select only required solutions when building libraries (#606)
• Build a universal macOS library when --macos_universal is set (#625, #646)
• Build release packages on GitHub Actions (#647)

v0.10.0

I have been writing tutorials for the past few weeks and have finally finished the basic parts.
This version includes scenes that can be used as templates, so I hope it's easier for more people to try this plugin.
If you find any errors in the tutorial, I would appreciate it if you could let me know.

I also have found several bugs and difficulties in using the plugin, which are fixed in this version.

⚠️ BREAKING CHANGES

• Upgrade the Unity version to 2021.3.3f1 (#588)
• plugin: Logger.minLogLevel -> Logger.MinLogLevel (#580)
• NativePacketCallback and NativeGlStatusFunction return StatusArgs instead of IntPtr (#574)
• Change CoordinateSystem method names and I/Fs (#569)
  • e.g. ImageCoordinate#GetLocalPosition -> ImageCoordinate#ImageToLocalPoint
  • The first argument type is now UnityEngine.Rect, not UnityEngine.RectTransform

Features

• Add scenes for tutorial (#582)
• plugin: MediaPipe v0.8.10 (#585)
• plugin: Implement GpuManager (#579)
• plugin: Add missing Status factory methods (#573)

Bug Fixes

• plugin: OutputStream#TryGetNext throws if StartPolling is not called (#581)
• Some tests abort on Windows (#572)
• Status instances returned by callback functions can be GCed prematurely (#574)
• TransformAnnotation value in the Objectron sample is incorrect (#569)

v0.9.3

Bug Fixes

• plugin: check if the target local asset is missing (#562)
• plugin: preserve Packet constructors for Reflection (#561)
• plugin: prevent Status returned by a packet callback from being GCed prematurely (#563)
• sample: dispose OutputStream if only it exists (#564)
• sample: the default video/image is not selected (#543)

v0.9.1

This release includes some requested features in the sample.

In addition to that, a menu button to export a unitypackage file is added.
I hope this makes it easier to use the plugin in another project.
Please read a wiki article for more information on how to import the plugin into your project!

Features

• sample: Pose Segmentation Mask (#520, #521)
• sample: Selfie Segmentation (#522)
• sample: MIN_DETECTION_CONFIDENCE and MIN_TRACKING_CONFIDENCE (#523)
• Set Protobuf LogHandler (#526)
  • libprotobuf logs can be displayed in the Console Window

Bug Fixes

• CalculatorGraph constructor does not throw if it fails to initialize (#533)

Build

• Export unitypackage + tarball (#531)
• Allow arbitrary options to be passed to Bazel (#537)

v0.9.0

Until now, this plugin has only ported the MediaPipe API verbatim, providing little high-level API except for the sample app code.
After this version, I plan to provide several higher-level APIs like Solution APIs.

This version introduces OutputStream API, which will be helpful to retrieve the output (I'll prepare the document later).

To upgrade your local plugin version, please uninstall the current version first since some file paths have changed.

python build.py uninstall
python build.py build ...

⚠️ BREAKING CHANGES

• implement ImageFrame#TryReadChannel and MaskShader (#507)
  • ImageFrame#ReadChannel is now removed
• reimplement ImageFrame extension methods (#508)
  • ImageFrame#CopyToByteBuffer/CopyToUshortBuffer/CopyToFloatBuffer -> ImageFrame#CopyToBuffer
• port missing protos (#502)
  • Mediapipe.Color may conflict with UnityEngine.Color

Features

• OutputStream API (#516)
• check Packet types at compile-time more properly (#509)

Performance

• Render the annotation for the hair mask using MaskShader (#507)

Bug Fixes

• Some Packet type constructors cause memory leak

v0.8.4

• Port ValidatedGraphConfig API (#477) (bde6874)
  • Now we can modify the CalculatorGraphConfig freely at runtime
• implement MIN_DETECTION_CONFIDENCE and MIN_TRACKING_CONFIDENCE options (#483) (13c2a38)
• Bug Fixes
  • Install OpenCV 3.4.16 on Docker Windows Containers (#484) (4210673)
  • Anchor position is flipped in the Instant Motion Tracking Scene (#506) (98cb0c4)
  • Front camera image is not rotated properly (#504) (9d47f7c)
  • The sample code may freeze on M1 Mac (#505) (9d7e390)

See CHANGELOG for more details.

v0.8.3

• Add Non-Blocking Sync mode to the sample app
• Enable to generate LLVM IR bitcode with emscripten (for WebGL)
• Detect PYTHON_BIN_PATH automatically
• Bug Fixes
  • SerializedProto's memory leaks (#461) (ac6316d)
  • Native libraries are not loaded with Load on Startup unchecked on Windows
  • smooth_landmarks option is not working (#454) (c90861c)
  • Build AAR on Docker (#441) (75a736a)
  • Memory for RenderTexture leaks (#451) (6a1d120)
  • etc...

See CHANGELOG for more details.

v0.8.2

• Upgrade MediaPipe to v0.8.9
  • Support Python 3.10
  • Fix Bazel version (4.2.1)

See CHANGELOG for more details.

v0.8.1

• Support M1 Mac (Experimental)
• Support Android build on Docker Windows (Experimental)
• Flip screen image when using front facing camera
• Validate bundle_id of MediaPipeUnity iOS Framework
• Bug Fixes
  • Hand Landmarks color is wrong in Holistic scene
  • memory leaks when using VideoSource
  • model_complexity is ignored in Pose and Holistic sample
  • Synchronize the input image and the output annotation (#359)
  • etc...

See CHANGELOG for more details.

v0.8.0

• MediaPipe v0.8.8 (#356)
  • Support refineLandmarks option (Face Mesh) (a76194f)
  • Support refineFaceLandmarks option (Holistic) (b669ac1)
• Allow the default camera resolution to be set (#347) (4826ee2) (by @ROBYER1 )
• Add .editorconfig and format code (#308)
• Bug Fixes
  • AssetBundle can be loaded only once (#309) (702434d)
  • Enable OpenCL on Android (383b373)
  • MediaPipeVideoGraph fails in CPU mode (ca77c3f)
  • etc...

See CHANGELOG for more details.