v0.12.0

Starting from this version, the symbols of the libraries included in the tarball and unitypackage have been stripped.
The libraries included in the MediaPipeUnityPlugin-all.zip still contain all symbols as before.

Please note that this version includes an upgrade to MediaPipe, but it does not incorporate the new features of MediaPipe.

⚠️ BREAKING CHANGES

• MediaPipe 0.10.1 (#924)
  • drop support for BoxTracking, Instant Motion Tracking and Objectron
• The minimum GLIBC version has changed (2.27 -> 2.31) (#921)
  • drop support for Ubuntu 18.04 (#922)

Bug Fixes

• include MediaPipeUnity.framework in unitypackage (#882)

Build

• remove the cmake_dynamic option (#932)

See CHANGELOG for more details.

v0.11.0

⚠️ BREAKING CHANGES

• make ResourceManager more customizable (#834) (1eac8b1)
  • hide StdString from developers

Features

• plugin: MediaPipe v0.9.1 (#840) (1a85630)

Build

• Upgrade the Unity version to 2021.3.18f1 (#856) (7679fad)

v0.10.3

From this version, MediaPipeUnityPlugin-all.zip, which contains all the source code and required libraries, is distributed.
That means you don't need to clone this repository and build libraries on your local machine to run the sample app.
(I deleted v0.10.2 because there was a mistake.)

Features

• Add FloatVectorPacket and MatrixPacket (#767) (391d7d9) (by @mgarbade)
• Make mask color transparent (#733) (f196f46)

Bug Fixes

• Wait longer time for the WebCam to start (#668) (436edb0) (by @DonghwanKIM0101)
• Avoid drawing holistic landmarks twice (#755) (30cd149) (by @Mids)
• Ignore core.autocrlf (#807) (f2bc51b)
• Stop running OnValidate on immutable prefabs (#810) (f545346)

Build

• The package layout has changed (#812) (4cd3a54)
• Export all the project files (#811) (a4c7077)

v0.10.1

In this version, pre-built packages are distributed for the first time (to know how it's built, see https://github.com/homuler/MediaPipeUnityPlugin/blob/v0.10.1/.github/workflows/package.yml).
GitHub Actions workflows are also set up, so once you fork this repository, I think you can build a package with your favorite options.

Features

objectron: Set confidence parameters from the UI (#605)

Bug Fixes

• docker build freezes when building a Docker Windows image (#631)
• OpenCV paths are wrong on macOS (#592)
• Some tests fail when built with GPU disabled (#634)
• Some tests fail on Windows (#644)

Build

• Upgrade the Bazel version to 5.2.0 (#623)
  • Now build fails with bazel 5.0.0
• Select only required solutions when building libraries (#606)
• Build a universal macOS library when --macos_universal is set (#625, #646)
• Build release packages on GitHub Actions (#647)

v0.10.0

I have been writing tutorials for the past few weeks and have finally finished the basic parts.
This version includes scenes that can be used as templates, so I hope it's easier for more people to try this plugin.
If you find any errors in the tutorial, I would appreciate it if you could let me know.

I also have found several bugs and difficulties in using the plugin, which are fixed in this version.

⚠️ BREAKING CHANGES

• Upgrade the Unity version to 2021.3.3f1 (#588)
• plugin: Logger.minLogLevel -> Logger.MinLogLevel (#580)
• NativePacketCallback and NativeGlStatusFunction return StatusArgs instead of IntPtr (#574)
• Change CoordinateSystem method names and I/Fs (#569)
  • e.g. ImageCoordinate#GetLocalPosition -> ImageCoordinate#ImageToLocalPoint
  • The first argument type is now UnityEngine.Rect, not UnityEngine.RectTransform

Features

• Add scenes for tutorial (#582)
• plugin: MediaPipe v0.8.10 (#585)
• plugin: Implement GpuManager (#579)
• plugin: Add missing Status factory methods (#573)

Bug Fixes

• plugin: OutputStream#TryGetNext throws if StartPolling is not called (#581)
• Some tests abort on Windows (#572)
• Status instances returned by callback functions can be GCed prematurely (#574)
• TransformAnnotation value in the Objectron sample is incorrect (#569)

v0.9.3

Bug Fixes

• plugin: check if the target local asset is missing (#562)
• plugin: preserve Packet constructors for Reflection (#561)
• plugin: prevent Status returned by a packet callback from being GCed prematurely (#563)
• sample: dispose OutputStream if only it exists (#564)
• sample: the default video/image is not selected (#543)

v0.9.1

This release includes some requested features in the sample.

In addition to that, a menu button to export a unitypackage file is added.
I hope this makes it easier to use the plugin in another project.
Please read a wiki article for more information on how to import the plugin into your project!

Features

• sample: Pose Segmentation Mask (#520, #521)
• sample: Selfie Segmentation (#522)
• sample: MIN_DETECTION_CONFIDENCE and MIN_TRACKING_CONFIDENCE (#523)
• Set Protobuf LogHandler (#526)
  • libprotobuf logs can be displayed in the Console Window

Bug Fixes

• CalculatorGraph constructor does not throw if it fails to initialize (#533)

Build

• Export unitypackage + tarball (#531)
• Allow arbitrary options to be passed to Bazel (#537)

v0.9.0

Until now, this plugin has only ported the MediaPipe API verbatim, providing little high-level API except for the sample app code.
After this version, I plan to provide several higher-level APIs like Solution APIs.

This version introduces OutputStream API, which will be helpful to retrieve the output (I'll prepare the document later).

To upgrade your local plugin version, please uninstall the current version first since some file paths have changed.

python build.py uninstall
python build.py build ...

⚠️ BREAKING CHANGES

• implement ImageFrame#TryReadChannel and MaskShader (#507)
  • ImageFrame#ReadChannel is now removed
• reimplement ImageFrame extension methods (#508)
  • ImageFrame#CopyToByteBuffer/CopyToUshortBuffer/CopyToFloatBuffer -> ImageFrame#CopyToBuffer
• port missing protos (#502)
  • Mediapipe.Color may conflict with UnityEngine.Color

Features

• OutputStream API (#516)
• check Packet types at compile-time more properly (#509)

Performance

• Render the annotation for the hair mask using MaskShader (#507)

Bug Fixes

• Some Packet type constructors cause memory leak

v0.8.4

• Port ValidatedGraphConfig API (#477) (bde6874)
  • Now we can modify the CalculatorGraphConfig freely at runtime
• implement MIN_DETECTION_CONFIDENCE and MIN_TRACKING_CONFIDENCE options (#483) (13c2a38)
• Bug Fixes
  • Install OpenCV 3.4.16 on Docker Windows Containers (#484) (4210673)
  • Anchor position is flipped in the Instant Motion Tracking Scene (#506) (98cb0c4)
  • Front camera image is not rotated properly (#504) (9d47f7c)
  • The sample code may freeze on M1 Mac (#505) (9d7e390)

See CHANGELOG for more details.

v0.8.3

• Add Non-Blocking Sync mode to the sample app
• Enable to generate LLVM IR bitcode with emscripten (for WebGL)
• Detect PYTHON_BIN_PATH automatically
• Bug Fixes
  • SerializedProto's memory leaks (#461) (ac6316d)
  • Native libraries are not loaded with Load on Startup unchecked on Windows
  • smooth_landmarks option is not working (#454) (c90861c)
  • Build AAR on Docker (#441) (75a736a)
  • Memory for RenderTexture leaks (#451) (6a1d120)
  • etc...

See CHANGELOG for more details.