MediaPipe Pose Landmarker Example App Android GPU Pose Landmarker Lite Crash on orientation change

[richardhfj]

Have I written custom code (as opposed to using a stock example script provided in MediaPipe)

None

OS Platform and Distribution

Android

Mobile device if the issue happens on mobile device

No response

Browser and version if the issue happens on browser

No response

Programming Language and version

Kotlin

MediaPipe version

latest example on git

Bazel version

No response

Solution

Pose Landmarker

Android Studio, NDK, SDK versions (if issue is related to building in Android environment)

No response

Xcode & Tulsi version (if issue is related to building for iOS)

No response

Describe the actual behavior

The Pose Landmarker when using GPU and Pose Landmarker Lite on Android will crash immediately after changing the camera orientation from portrait to landscape and vice versa.

Describe the expected behaviour

The Pose Landmarker when using GPU and Pose Landmarker Lite on Android will be able to reinitiate after the camera orientation change from portrait to landscape and vice versa and reinitiate without crashing.

Standalone code/steps you may have used to try to get what you need

Set up Android Mediapipe Pose Landmarker example app with default settings. Tab switch to Pose Landmarker Lite and GPU, and then change mobile device orientation from portrait to landscape, and the app will crash.

Other info / Complete Logs

1. Set up the Android Mediapipe example app for Pose Landmarker. Use all default settings starting with Pose Landmarker Full and CPU Delegate.
2. Open the tab menu, change the Model to Pose Landmarker Lite and Delegate to GPU
3. As soon as you change the camera orientation from Portrait to Landscape or Landscape back to Portrait, you will see a black screen for the camera while it is reloading, and then the app will crash.
4. This problem does not happen when you use Pose Landmarker Full using CPU for some reason. You can change orientations as many times as you want, it is still stable. If you were to start the example app, change the settings to GPU and Pose Landmarker Lite and do not change the orientation, then the App will also not crash.

As I'm primarily using this on Android mobile, it is a lot better to use GPU and Lite, especially on slower Android phones where inference times can get over 150 ms.

Ok, please let me know if any questions, thank you.


-Richard

[kuaashish]

Hi @richardhfj,

Could you please share the complete error log you are encountering? This will help us investigate and work on a fix more effectively.

Thank you!!