mediapipe: [adnroid ] unable to get camera preview when using objectdectioncpu, objectdectiongpu works.

The same device can run mlkit’s sample with no issue https://github.com/googlesamples/mlkit

however, when running mediapipe’s objectdectioncpu example, I can’t get a camera preview or any results.

objectdectiongpu can open the camera with a longer delay than mlkit. where should I start to debug the problem? Thanks

Here is the log I run objectdectioncpu

2021-03-22 14:46:53.049 5736-5736/com.google.mediapipe.apps.objectdetectioncpu W/ActivityThread: handleWindowVisibility: no activity for token android.os.BinderProxy@c9b8066
2021-03-22 14:46:53.089 5736-5736/com.google.mediapipe.apps.objectdetectioncpu I/native: I20210322 14:46:53.089723  5736 asset_manager_util.cc:59] Created global reference to asset manager.
2021-03-22 14:46:53.095 5736-5736/com.google.mediapipe.apps.objectdetectioncpu E/libEGL: eglMakeCurrent:1028 error 300d (EGL_BAD_SURFACE)
2021-03-22 14:46:53.095 5736-5736/com.google.mediapipe.apps.objectdetectioncpu I/native: I20210322 14:46:53.095924  5736 gl_context_egl.cc:163] Successfully initialized EGL. Major : 1 Minor: 4
2021-03-22 14:46:53.097 5736-5836/com.google.mediapipe.apps.objectdetectioncpu I/native: I20210322 14:46:53.097872  5836 gl_context.cc:331] GL version: 3.2 (OpenGL ES 3.2 v1.r16p0-01rel0.45b161e1b2cff94b03faf73ffeb6b9a5)
2021-03-22 14:46:53.098 5736-5736/com.google.mediapipe.apps.objectdetectioncpu D/PermissionHelper: checkAndRequestCameraPermissions
2021-03-22 14:46:53.104 5736-5837/com.google.mediapipe.apps.objectdetectioncpu D/GlThread: Starting GL thread ExternalTextureConverter
2021-03-22 14:46:53.128 5736-5736/com.google.mediapipe.apps.objectdetectioncpu D/CameraOrientationUtil: getRelativeImageRotation: destRotationDegrees=0, sourceRotationDegrees=0, isOppositeFacing=true, result=0
2021-03-22 14:46:53.132 5736-5736/com.google.mediapipe.apps.objectdetectioncpu D/DeferrableSurface: Surface created[total_surfaces=1, used_surfaces=0](androidx.camera.core.SurfaceRequest$2@76a864c}
2021-03-22 14:46:53.135 5736-5736/com.google.mediapipe.apps.objectdetectioncpu D/CameraOrientationUtil: getRelativeImageRotation: destRotationDegrees=0, sourceRotationDegrees=0, isOppositeFacing=true, result=0
2021-03-22 14:46:53.135 5736-5838/com.google.mediapipe.apps.objectdetectioncpu D/CameraXPreviewHelper: Received surface request for resolution 1600x1200
2021-03-22 14:46:53.142 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/UseCaseAttachState: Active and attached use case: [] for camera: 0
2021-03-22 14:46:53.144 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/UseCaseAttachState: All use case: [androidx.camera.core.Preview-fecf4293-85a3-4c2d-86f6-4526634ebb08161899993] for camera: 0
2021-03-22 14:46:53.145 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/UseCaseAttachState: Active and attached use case: [androidx.camera.core.Preview-fecf4293-85a3-4c2d-86f6-4526634ebb08161899993] for camera: 0
2021-03-22 14:46:53.146 5736-5838/com.google.mediapipe.apps.objectdetectioncpu I/ectdetectioncp: IncrementDisableThreadFlip blocked for 11.112ms
2021-03-22 14:46:53.148 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/CameraStateRegistry: tryOpenCamera(Camera@9fbaa47[id=0]) [Available Cameras: 1, Already Open: false (Previous state: CLOSED)] --> SUCCESS
2021-03-22 14:46:53.149 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/CameraStateRegistry: Recalculating open cameras:
    Camera                                       State                 
    -------------------------------------------------------------------
    Camera@9fbaa47[id=0]                         OPENING               
    Camera@a2d21e0[id=1]                         UNKNOWN               
    -------------------------------------------------------------------
    Open count: 1 (Max allowed: 1)
2021-03-22 14:46:53.149 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/UseCaseAttachState: All use case: [androidx.camera.core.Preview-fecf4293-85a3-4c2d-86f6-4526634ebb08161899993] for camera: 0
2021-03-22 14:46:53.150 5736-5838/com.google.mediapipe.apps.objectdetectioncpu D/CameraXPreviewHelper: Providing surface
2021-03-22 14:46:53.151 5736-5778/com.google.mediapipe.apps.objectdetectioncpu D/mali_winsys: EGLint new_window_surface(egl_winsys_display *, void *, EGLSurface, EGLConfig, egl_winsys_surface **, EGLBoolean) returns 0x3000
2021-03-22 14:46:53.172 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/UseCaseAttachState: Active and attached use case: [androidx.camera.core.Preview-fecf4293-85a3-4c2d-86f6-4526634ebb08161899993] for camera: 0
2021-03-22 14:46:53.175 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/CameraStateRegistry: Recalculating open cameras:
    Camera                                       State                 
    -------------------------------------------------------------------
    Camera@9fbaa47[id=0]                         OPEN                  
    Camera@a2d21e0[id=1]                         UNKNOWN               
    -------------------------------------------------------------------
    Open count: 1 (Max allowed: 1)
2021-03-22 14:46:53.176 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/UseCaseAttachState: All use case: [androidx.camera.core.Preview-fecf4293-85a3-4c2d-86f6-4526634ebb08161899993] for camera: 0
2021-03-22 14:46:53.178 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/DeferrableSurface: New surface in use[total_surfaces=1, used_surfaces=1](androidx.camera.core.SurfaceRequest$2@76a864c}
2021-03-22 14:46:53.178 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/DeferrableSurface: use count+1, useCount=1 androidx.camera.core.SurfaceRequest$2@76a864c
2021-03-22 14:46:53.178 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/CaptureSession: Opening capture session.
2021-03-22 14:46:53.284 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/CaptureSession: Attempting to send capture request onConfigured
2021-03-22 14:46:53.284 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/CaptureSession: Issuing request for session.
2021-03-22 14:46:53.289 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/CaptureSession: CameraCaptureSession.onConfigured() mState=OPENED
2021-03-22 14:46:53.289 5736-5777/com.google.mediapipe.apps.objectdetectioncpu D/CaptureSession: CameraCaptureSession.onReady() OPENED
2021-03-22 14:46:53.620 5736-5838/com.google.mediapipe.apps.objectdetectioncpu D/CameraOrientationUtil: getRelativeImageRotation: destRotationDegrees=0, sourceRotationDegrees=0, isOppositeFacing=true, result=0
2021-03-22 14:46:53.653 5736-5836/com.google.mediapipe.apps.objectdetectioncpu D/mali_winsys: EGLint new_window_surface(egl_winsys_display *, void *, EGLSurface, EGLConfig, egl_winsys_surface **, EGLBoolean) returns 0x3000

and logs for objectdectiongpu

2021-03-22 14:48:38.680 5668-5668/com.google.mediapipe.apps.objectdetectiongpu W/ActivityThread: handleWindowVisibility: no activity for token android.os.BinderProxy@264f0c1
2021-03-22 14:48:38.728 5668-5668/com.google.mediapipe.apps.objectdetectiongpu I/native: I20210322 14:48:38.728003  5668 asset_manager_util.cc:59] Created global reference to asset manager.
2021-03-22 14:48:38.730 5668-5668/com.google.mediapipe.apps.objectdetectiongpu E/libEGL: eglMakeCurrent:1028 error 300d (EGL_BAD_SURFACE)
2021-03-22 14:48:38.731 5668-5668/com.google.mediapipe.apps.objectdetectiongpu I/native: I20210322 14:48:38.731772  5668 gl_context_egl.cc:163] Successfully initialized EGL. Major : 1 Minor: 4
2021-03-22 14:48:38.734 5668-5853/com.google.mediapipe.apps.objectdetectiongpu I/native: I20210322 14:48:38.734324  5853 gl_context.cc:331] GL version: 3.2 (OpenGL ES 3.2 v1.r16p0-01rel0.45b161e1b2cff94b03faf73ffeb6b9a5)
2021-03-22 14:48:38.735 5668-5668/com.google.mediapipe.apps.objectdetectiongpu D/PermissionHelper: checkAndRequestCameraPermissions
2021-03-22 14:48:38.747 5668-5854/com.google.mediapipe.apps.objectdetectiongpu D/GlThread: Starting GL thread ExternalTextureConverter
2021-03-22 14:48:38.770 5668-5668/com.google.mediapipe.apps.objectdetectiongpu D/CameraOrientationUtil: getRelativeImageRotation: destRotationDegrees=0, sourceRotationDegrees=0, isOppositeFacing=true, result=0
2021-03-22 14:48:38.774 5668-5668/com.google.mediapipe.apps.objectdetectiongpu D/DeferrableSurface: Surface created[total_surfaces=1, used_surfaces=0](androidx.camera.core.SurfaceRequest$2@7b2667f}
2021-03-22 14:48:38.775 5668-5668/com.google.mediapipe.apps.objectdetectiongpu D/CameraOrientationUtil: getRelativeImageRotation: destRotationDegrees=0, sourceRotationDegrees=0, isOppositeFacing=true, result=0
2021-03-22 14:48:38.775 5668-5855/com.google.mediapipe.apps.objectdetectiongpu D/CameraXPreviewHelper: Received surface request for resolution 1600x1200
2021-03-22 14:48:38.776 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/UseCaseAttachState: Active and attached use case: [] for camera: 0
2021-03-22 14:48:38.777 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/UseCaseAttachState: All use case: [androidx.camera.core.Preview-797af778-6a1b-4f90-8f08-e47e3d04d2b840699936] for camera: 0
2021-03-22 14:48:38.778 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/UseCaseAttachState: Active and attached use case: [androidx.camera.core.Preview-797af778-6a1b-4f90-8f08-e47e3d04d2b840699936] for camera: 0
2021-03-22 14:48:38.781 5668-5855/com.google.mediapipe.apps.objectdetectiongpu D/CameraXPreviewHelper: Providing surface
2021-03-22 14:48:38.782 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/CameraStateRegistry: tryOpenCamera(Camera@1600186[id=0]) [Available Cameras: 1, Already Open: false (Previous state: CLOSED)] --> SUCCESS
2021-03-22 14:48:38.784 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/CameraStateRegistry: Recalculating open cameras:
    Camera                                       State                 
    -------------------------------------------------------------------
    Camera@1600186[id=0]                         OPENING               
    Camera@baab012[id=1]                         UNKNOWN               
    -------------------------------------------------------------------
    Open count: 1 (Max allowed: 1)
2021-03-22 14:48:38.785 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/UseCaseAttachState: All use case: [androidx.camera.core.Preview-797af778-6a1b-4f90-8f08-e47e3d04d2b840699936] for camera: 0
2021-03-22 14:48:38.798 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/UseCaseAttachState: Active and attached use case: [androidx.camera.core.Preview-797af778-6a1b-4f90-8f08-e47e3d04d2b840699936] for camera: 0
2021-03-22 14:48:38.799 5668-5710/com.google.mediapipe.apps.objectdetectiongpu D/mali_winsys: EGLint new_window_surface(egl_winsys_display *, void *, EGLSurface, EGLConfig, egl_winsys_surface **, EGLBoolean) returns 0x3000
2021-03-22 14:48:38.800 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/CameraStateRegistry: Recalculating open cameras:
    Camera                                       State                 
    -------------------------------------------------------------------
    Camera@1600186[id=0]                         OPEN                  
    Camera@baab012[id=1]                         UNKNOWN               
    -------------------------------------------------------------------
    Open count: 1 (Max allowed: 1)
2021-03-22 14:48:38.801 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/UseCaseAttachState: All use case: [androidx.camera.core.Preview-797af778-6a1b-4f90-8f08-e47e3d04d2b840699936] for camera: 0
2021-03-22 14:48:38.802 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/DeferrableSurface: New surface in use[total_surfaces=1, used_surfaces=1](androidx.camera.core.SurfaceRequest$2@7b2667f}
2021-03-22 14:48:38.802 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/DeferrableSurface: use count+1, useCount=1 androidx.camera.core.SurfaceRequest$2@7b2667f
2021-03-22 14:48:38.802 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/CaptureSession: Opening capture session.
2021-03-22 14:48:38.884 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/CaptureSession: Attempting to send capture request onConfigured
2021-03-22 14:48:38.884 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/CaptureSession: Issuing request for session.
2021-03-22 14:48:38.885 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/CaptureSession: CameraCaptureSession.onConfigured() mState=OPENED
2021-03-22 14:48:38.885 5668-5711/com.google.mediapipe.apps.objectdetectiongpu D/CaptureSession: CameraCaptureSession.onReady() OPENED
2021-03-22 14:48:39.215 5668-5855/com.google.mediapipe.apps.objectdetectiongpu D/CameraOrientationUtil: getRelativeImageRotation: destRotationDegrees=0, sourceRotationDegrees=0, isOppositeFacing=true, result=0
2021-03-22 14:48:39.237 5668-5853/com.google.mediapipe.apps.objectdetectiongpu D/mali_winsys: EGLint new_window_surface(egl_winsys_display *, void *, EGLSurface, EGLConfig, egl_winsys_surface **, EGLBoolean) returns 0x3000
2021-03-22 14:48:39.248 5668-5854/com.google.mediapipe.apps.objectdetectiongpu D/ExternalTextureConv: Created output texture: 2 width: 1600 height: 1200
2021-03-22 14:48:39.256 5668-5854/com.google.mediapipe.apps.objectdetectiongpu I/native: I20210322 14:48:39.256675  5854 graph.cc:411] Start running the graph, waiting for inputs.
2021-03-22 14:48:39.256 5668-5854/com.google.mediapipe.apps.objectdetectiongpu I/native: I20210322 14:48:39.256820  5854 gl_context_egl.cc:163] Successfully initialized EGL. Major : 1 Minor: 4
2021-03-22 14:48:39.263 5668-5869/com.google.mediapipe.apps.objectdetectiongpu I/native: I20210322 14:48:39.263001  5869 gl_context.cc:331] GL version: 3.2 (OpenGL ES 3.2 v1.r16p0-01rel0.45b161e1b2cff94b03faf73ffeb6b9a5)
2021-03-22 14:48:39.279 5668-5854/com.google.mediapipe.apps.objectdetectiongpu D/ExternalTextureConv: Created output texture: 3 width: 1600 height: 1200

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Comments: 15

Most upvoted comments

sorry for the late reply, we had a national holiday last week. I reproduced it once. I’ll try to get the trace

+1
yangcheng on May 6, 2021
Read more comments on GitHub
← mediapipe: Unable to open file at \test\hand_landmarker.task
mediapipe: Android hand tracking error:use aar in my own project →