mediapipe: Graph does not call output callback

Please make sure that this is a solution issue.

System information (Please provide as much relevant information as possible)

  • Have I written custom code (as opposed to using a stock example script provided in Mediapipe): yes
  • OS Platform and Distribution (e.g., Linux Ubuntu 16.04, Android 11, iOS 14.4): Android
  • MediaPipe version: 0.8.6
  • Bazel version:
  • Solution (e.g. FaceMesh, Pose, Holistic): Hand tracking
  • Programming Language and version : (Kotlin, AAR), (C#, Unity)

Describe the expected behavior: Output callback invoked fore hand_landmarks

Standalone code you may have used to try to get what you need :

init {
    AndroidAssetUtil.initializeNativeAssetManager(context)

    graph.loadBinaryGraph(AndroidAssetUtil.getAssetBytes(context.assets, BINARY_GRAPH_NAME))
    packetCreator = AndroidPacketCreator(graph)
    inputSidePackets[INPUT_NUM_HANDS_SIDE_PACKET_NAME] = packetCreator.createInt32(numHands)

    graph.setParentGlContext(eglManager.nativeContext)
    graph.setInputSidePackets(inputSidePackets)

    graph.addSurfaceOutput(OUTPUT_VIDEO_STREAM_NAME).setFlipY(flipFramesVertically)
    graph.addPacketCallback(OUTPUT_LANDMARKS_STREAM_NAME) { packet: Packet ->
        Log.v(TAG, "Received multi-hand landmarks packet.")
        try {
            callback.onReceiveData(packetLandmark2JSON(packet))
        } catch (e: Exception) {
            Log.e(TAG, "Error while get packet: ", e)
        }
    }
}

@JvmName("Open")
fun open() {
    Log.v(TAG, "Ready converter.")
    converter = ExternalTextureConverter(eglManager.context, 2)
    converter!!.setFlipY(flipFramesVertically)
    converter!!.setConsumer { frame -> graph.addConsumablePacketToInputStream(INPUT_VIDEO_STREAM_NAME, packetCreator.createGpuBuffer(frame), frame.timestamp) }

    if (!started.getAndSet(true)) {
        graph.startRunningGraph()
    }
}

@JvmName("UpdateTexture")
fun updateTexture(texture: Int, width: Int, height: Int) {
    Log.v(TAG, "Update surface texture.")
    try {
        surfaceTexture?.release()
        surfaceTexture = SurfaceTexture(texture)
        converter?.setSurfaceTexture(surfaceTexture, width, height)
    } catch (e: Exception) {
        Log.e(TAG, "Error occured while update texture", e)
    }
}

Other info / Complete Logs : In the 265 line, It seems success to initialize graph, but output callback does not invoked. GL texture name in updateTexture method is produced by Unity RenderTexture.GetNativeTexturePtr

2021-07-20 17:58:43.013 30175 30175 Error Zygote isWhitelistProcess - Process is Whitelisted
2021-07-20 17:58:43.016 30175 30175 Error Zygote accessInfo : 1
2021-07-20 17:58:43.031 30175 30175 Error HandtrackingAA Not starting debugger since process cannot load the jdwp agent.
2021-07-20 17:58:43.168 30175 30175 Info Mono JNI_OnLoad called
2021-07-20 17:58:43.181 30175 30175 Info OpenGLRenderer RenderNode setPositionListener(0xe38d6bc0) is called
2021-07-20 17:58:43.204 30175 30175 Info MultiWindowDecorSupport [INFO] isPopOver = false
2021-07-20 17:58:43.204 30175 30175 Info MultiWindowDecorSupport updateCaptionType >> DecorView@dc55fca[], isFloating: false, isApplication: true, hasWindowDecorCaption: false, hasWindowControllerCallback: true
2021-07-20 17:58:43.235 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] setView = com.android.internal.policy.DecorView@dc55fca TM=true MM=false
2021-07-20 17:58:43.240 30175 30175 Info SurfaceView onWindowVisibilityChanged(0) true android.view.SurfaceView{468bfed VFE...... .F....I. 0,0-0,0 #7f0800fe app:id/unitySurfaceView} of ViewRootImpl@a3eee04[UnityPlayerActivity]
2021-07-20 17:58:43.251 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] Relayout returned: old=(0,0,1080,2220) new=(0,0,1080,2220) req=(1080,2220)0 dur=11 res=0x7 s={true 3457259520} ch=true
2021-07-20 17:58:43.260 30175 30175 Info SurfaceView surfaceCreated 1 #8 android.view.SurfaceView{468bfed VFE...... .F....ID 0,0-1080,2094 #7f0800fe app:id/unitySurfaceView}
2021-07-20 17:58:43.261 30175 30175 Info SurfaceView surfaceChanged (1080,2094) 1 #8 android.view.SurfaceView{468bfed VFE...... .F....ID 0,0-1080,2094 #7f0800fe app:id/unitySurfaceView}
2021-07-20 17:58:43.270 30175 30175 Warn Gralloc3 mapper 3.x is not supported
2021-07-20 17:58:43.276 30175 30175 Info gralloc Arm Module v1.0
2021-07-20 17:58:43.303 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] Relayout returned: old=(0,0,1080,2220) new=(0,0,1080,2220) req=(1080,2220)0 dur=13 res=0x1 s={true 3457259520} ch=false
2021-07-20 17:58:43.303 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] MSG_WINDOW_FOCUS_CHANGED 1 1
2021-07-20 17:58:43.307 30175 30175 Info InputMethodManager startInputInner - mService.startInputOrWindowGainedFocus
2021-07-20 17:58:43.319 30175 1777 Info Unity MemoryManager: Using 'Dynamic Heap' Allocator.
2021-07-20 17:58:43.319 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] MSG_RESIZED: frame=(0,0,1080,2220) ci=(0,0,0,126) vi=(0,63,0,126) or=1
2021-07-20 17:58:43.350 30175 1777 Info Unity SystemInfo CPU = ARM64 FP ASIMD AES, Cores = 8, Memory = 5615mb
2021-07-20 17:58:43.350 30175 1777 Info Unity 
2021-07-20 17:58:43.350 30175 1777 Info Unity SystemInfo ARM big.LITTLE configuration: 4 big (mask: 0xf0), 4 little (mask: 0xf)
2021-07-20 17:58:43.350 30175 1777 Info Unity 
2021-07-20 17:58:43.350 30175 1777 Info Unity ApplicationInfo com.DefaultCompany.HandtrackingAAR version 0.1 build 36a80568-6aa6-4ab3-bc8f-b2993e5cf52e
2021-07-20 17:58:43.350 30175 1777 Info Unity 
2021-07-20 17:58:43.350 30175 1777 Info Unity Built from '2021.1/draft/staging' branch, Version '2021.1.13f1 (46f3b9702e2b)', Build type 'Release', Scripting Backend 'mono', CPU 'armeabi-v7a', Stripping 'Disabled'
2021-07-20 17:58:43.350 30175 1777 Info Unity 
2021-07-20 17:58:43.365 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] Relayout returned: old=(0,0,1080,2220) new=(0,0,1080,2220) req=(1080,2220)0 dur=8 res=0x1 s={true 3457259520} ch=false
2021-07-20 17:58:43.389 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] Relayout returned: old=(0,0,1080,2220) new=(0,0,1080,2220) req=(1080,2220)0 dur=16 res=0x1 s={true 3457259520} ch=false
2021-07-20 17:58:43.391 30175 30175 Info SurfaceView surfaceChanged (1080,2220) 1 #5 android.view.SurfaceView{468bfed VFE...... .F....ID 0,0-1080,2220 #7f0800fe app:id/unitySurfaceView}
2021-07-20 17:58:43.419 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] MSG_RESIZED: frame=(0,0,1080,2220) ci=(0,0,0,126) vi=(0,63,0,0) or=1
2021-07-20 17:58:43.452 30175 1777 Error libprocessgroup set_timerslack_ns write failed: Operation not permitted
2021-07-20 17:58:43.453 30175 1777 Info chatty uid=10557(com.DefaultCompany.HandtrackingAAR) UnityMain identical 14 lines
2021-07-20 17:58:43.453 30175 1777 Error libprocessgroup set_timerslack_ns write failed: Operation not permitted
2021-07-20 17:58:43.472 30175 1777 Info Unity Company Name: DefaultCompany
2021-07-20 17:58:43.472 30175 1777 Info Unity Product Name: HandtrackingAAR
2021-07-20 17:58:43.521 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] MSG_RESIZED: frame=(0,0,1080,2220) ci=(0,0,0,126) vi=(0,0,0,0) or=1
2021-07-20 17:58:43.576 30175 1777 Info mali_winsys new_window_surface() [1080x2220] return: 0x3000
2021-07-20 17:58:43.608 30175 1885 Info SwappyDisplayManager Starting looper thread
2021-07-20 17:58:43.628 30175 1777 Info libOpenSLES Emulating old channel mask behavior (ignoring positional mask 0x3, using default mask 0x3 based on channel count of 2)
2021-07-20 17:58:43.629 30175 1777 Warn AudioTrack set(): notificationFrames=-21 clamped to the range -1 to -8
2021-07-20 17:58:43.634 30175 1777 Info AudioTrack createTrack_l(0): AUDIO_OUTPUT_FLAG_FAST successful; frameCount 0 -> 1536
2021-07-20 17:58:43.821 30175 1777 Info MONO Getting locale
2021-07-20 17:58:43.822 30175 1777 Info Mono Locale ko-KR
2021-07-20 17:58:44.215 30175 1777 Info Unity XRGeneral Settings awakening...
2021-07-20 17:58:44.215 30175 1777 Info Unity 
2021-07-20 17:58:44.401 30175 1777 Info native arpresto_api.cc:30 ArPresto::ArPresto_initialize
2021-07-20 17:58:44.646 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] Relayout returned: old=(0,0,1080,2220) new=(0,0,1080,2220) req=(1080,2220)0 dur=3 res=0x1 s={true 3457259520} ch=false
2021-07-20 17:58:44.717 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] Relayout returned: old=(0,0,1080,2220) new=(0,0,1080,2220) req=(1080,2220)0 dur=7 res=0x1 s={true 3457259520} ch=false
2021-07-20 17:58:46.605 30175 1777 Info native arpresto_api.cc:77 ArPresto::ArPresto_checkApkAvailability
2021-07-20 17:58:46.773 30175 1777 Info native arpresto_api.cc:36 ArPresto::ArPresto_handleActivityResume
2021-07-20 17:58:46.788 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] Relayout returned: old=(0,0,1080,2220) new=(0,0,1080,2220) req=(1080,2220)0 dur=5 res=0x1 s={true 3457259520} ch=false
2021-07-20 17:58:47.136 30175 1777 Info native arpresto_api.cc:156 ArPresto::ArPresto_setCameraTextureNames
2021-07-20 17:58:47.136 30175 1777 Info native arpresto_api.cc:175 ArPresto::ArPresto_setEnabled
2021-07-20 17:58:47.765 30175 1777 Info native arpresto_api.cc:118 ArPresto::ArPresto_setDeviceCameraDirection
2021-07-20 17:58:47.839 30175 1777 Info third_party/arcore/ar/core/android/sdk/session_create.cc Entering ArSession_createWithFeatures
2021-07-20 17:58:47.839 30175 1777 Info third_party/arcore/ar/core/android/sdk/session_create.cc ARCore Version: SDK build name: 1.22
2021-07-20 17:58:47.842 30175 1777 Info third_party/arcore/ar/core/android/sdk/session_create.cc ARCore Version: APK version code: 211460203
2021-07-20 17:58:47.856 30175 1777 Info third_party/arcore/ar/core/android/sdk/session_create.cc Dynamite load ok.
2021-07-20 17:58:47.856 30175 1777 Info third_party/arcore/java/com/google/vr/dynamite/client/native/dynamite_client.cc Attempting to load native library arcore_c from package com.google.ar.core
2021-07-20 17:58:47.864 30175 1777 Info OpenCV cpufeatures library is not avaialble for CPU detection
2021-07-20 17:58:47.864 30175 1777 Info OpenCV - NEON instructions is enabled via build flags
2021-07-20 17:58:47.864 30175 1777 Info OpenCV - FP16 instructions is enabled via build flags
2021-07-20 17:58:47.875 30175 1777 Info third_party/arcore/java/com/google/vr/dynamite/client/native/dynamite_client.cc Dynamite::LoadNativeRemoteLibrary handle=840709749
2021-07-20 17:58:47.875 30175 1777 Info third_party/arcore/ar/core/android/sdk/session_create.cc ARCore SDK: dynamite number_of_symbols_loaded=226
2021-07-20 17:58:47.876 30175 1777 Info native I0720 17:58:47.876013    1777 session_create_implementation.cc:238] Entering createImplementationWithFeaturesAndSettings. ARCore SDK version: [1.22.202940000].
2021-07-20 17:58:47.900 30175 1777 Info native I0720 17:58:47.900355    1777 session_create_implementation.cc:202] AugmentedRegion downsample mode from Phenotype: true
2021-07-20 17:58:47.914 30175 1777 Info native I0720 17:58:47.914321    1777 session_create_implementation_shared.cc:1879] min_apk_version_code is: 202940000, phenotype flag of enable_dual_camera_support is: false, phenotype flag of unified_data_source_status is: 1, phenotype flag of unified_shared_cameras_status is: 1, is_dual_camera_supported based on device profile is: false
2021-07-20 17:58:47.914 30175 1777 Info native I0720 17:58:47.914376    1777 session_create_implementation_shared.cc:1892] Settings.camera_stack_option is not specified
2021-07-20 17:58:47.914 30175 1777 Info native I0720 17:58:47.914396    1777 session_create_implementation_shared.cc:1933] Datasource will be created with camera_stack_option = kNdk
2021-07-20 17:58:47.914 30175 1777 Info native I0720 17:58:47.914489    1777 session_create_implementation_shared.cc:2068] Persistent online recalibration is enabled by Phenotype.
2021-07-20 17:58:47.915 30175 1777 Info tflite Initialized TensorFlow Lite runtime.
2021-07-20 17:58:47.916 30175 1777 Info native I0720 17:58:47.915988    1777 online_calibration_manager.cc:106] OnlineCalibrationManager: Read online recalibration file successfully.
2021-07-20 17:58:47.926 30175 1777 Warn ARCore-ContextUtils The API key for use with the Google AR service could not be obtained!
2021-07-20 17:58:47.945 30175 1777 Info native I0720 17:58:47.945585    1777 session_create_implementation_shared.cc:844] Datasource will be created with timeout = 4s, should_wait = false, should_use_greedy_recovery = true
2021-07-20 17:58:47.945 30175 1777 Info native I0720 17:58:47.945685    1777 android_camera.cc:169] Camera start operation timeout set to 4000 ms.
2021-07-20 17:58:47.945 30175 1777 Info native I0720 17:58:47.945746    1777 android_camera.cc:1827] Initializing camera manager.
2021-07-20 17:58:47.957 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 851980! count 0, type 3
2021-07-20 17:58:47.957 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638402! count 0, type 3
2021-07-20 17:58:47.957 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638403! count 0, type 3
2021-07-20 17:58:47.957 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1835009! count 0, type 3
2021-07-20 17:58:47.957 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1835010! count 0, type 3
2021-07-20 17:58:47.957 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638407! count 0, type 3
2021-07-20 17:58:47.957 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638408! count 0, type 3
2021-07-20 17:58:47.957 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 851980! count 0, type 3
2021-07-20 17:58:47.958 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638402! count 0, type 3
2021-07-20 17:58:47.958 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638403! count 0, type 3
2021-07-20 17:58:47.958 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1835009! count 0, type 3
2021-07-20 17:58:47.958 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1835010! count 0, type 3
2021-07-20 17:58:47.958 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638407! count 0, type 3
2021-07-20 17:58:47.958 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638408! count 0, type 3
2021-07-20 17:58:47.958 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 851980! count 0, type 3
2021-07-20 17:58:47.958 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638402! count 0, type 3
2021-07-20 17:58:47.958 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638403! count 0, type 3
2021-07-20 17:58:47.958 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1835009! count 0, type 3
2021-07-20 17:58:47.958 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1835010! count 0, type 3
2021-07-20 17:58:47.958 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638407! count 0, type 3
2021-07-20 17:58:47.958 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638408! count 0, type 3
2021-07-20 17:58:47.959 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 851980! count 0, type 3
2021-07-20 17:58:47.959 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638402! count 0, type 3
2021-07-20 17:58:47.959 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638403! count 0, type 3
2021-07-20 17:58:47.959 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1835009! count 0, type 3
2021-07-20 17:58:47.959 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1835010! count 0, type 3
2021-07-20 17:58:47.959 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638407! count 0, type 3
2021-07-20 17:58:47.959 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638408! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 851980! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638402! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638403! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1835009! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1835010! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638407! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638408! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 851980! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638402! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638403! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1835009! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1835010! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638407! count 0, type 3
2021-07-20 17:58:47.968 30175 1777 Error ACameraMetadata filterDurations: malformed duration key 1638408! count 0, type 3
2021-07-20 17:58:47.969 30175 1777 Info native I0720 17:58:47.969111    1777 android_camera.cc:1853] Camera manager initialized successfully with 3 cameras.
2021-07-20 17:58:47.970 30175 1777 Info native I0720 17:58:47.970235    1777 imagereader_ndk_wrapper.cc:47] Loading Android NDK 26 symbols from libmediandk.so
2021-07-20 17:58:47.970 30175 1777 Info native I0720 17:58:47.970534    1777 imagereader_ndk_wrapper.cc:70] Successfully loaded Android NDK 26 libmediandk.so symbols.
2021-07-20 17:58:47.970 30175 1777 Info native I0720 17:58:47.970569    1777 cameras.cc:123] Number of hardware buffers is 16. sdk_version=29, is_hardware_buffer_supported=true
2021-07-20 17:58:47.971 30175 1777 Info native I0720 17:58:47.971139    1777 android_sensors.cc:107] Using uncalibrated accelerometer.
2021-07-20 17:58:47.971 30175 1777 Info native I0720 17:58:47.971333    1777 android_sensors.cc:146] Uncalibrated magnetometer available.
2021-07-20 17:58:47.971 30175 1777 Info native I0720 17:58:47.971441    1777 android_sensors.cc:150] Calibrated magnetometer available.
2021-07-20 17:58:47.971 30175 1777 Info native I0720 17:58:47.971546    1777 android_sensors.cc:163] Using SENSOR_TYPE_LIGHT
2021-07-20 17:58:47.971 30175 1777 Info native I0720 17:58:47.971642    1777 android_sensors.cc:163] Using SENSOR_TYPE_PRESSURE
2021-07-20 17:58:47.971 30175 1777 Info native I0720 17:58:47.971736    1777 android_sensors.cc:163] Using SENSOR_TYPE_PROXIMITY
2021-07-20 17:58:47.971 30175 1777 Info native I0720 17:58:47.971830    1777 android_sensors.cc:163] Using SENSOR_TYPE_GRAVITY
2021-07-20 17:58:47.971 30175 1777 Info native I0720 17:58:47.971925    1777 android_sensors.cc:163] Using SENSOR_TYPE_ROTATION_VECTOR
2021-07-20 17:58:47.972 30175 1777 Info native I0720 17:58:47.972017    1777 android_sensors.cc:163] Using SENSOR_TYPE_GAME_ROTATION_VECTOR
2021-07-20 17:58:47.972 30175 1777 Info native I0720 17:58:47.972083    1777 android_sensors.cc:166] Could not find SENSOR_TYPE_GEOMAGNETIC_ROTATION_VECTOR
2021-07-20 17:58:47.972 30175 1777 Info native I0720 17:58:47.972146    1777 android_sensors.cc:163] Using SENSOR_TYPE_STEP_DETECTOR
2021-07-20 17:58:47.974 30175 1777 Info native I0720 17:58:47.974190    1777 android_platform_checks.cc:196] IsZeroRotationLandscape = false
2021-07-20 17:58:47.975 30175 1777 Info native I0720 17:58:47.975286    1777 app_version_util.cc:50] Package name: com.google.ar.core App version: 1.25.211460203
2021-07-20 17:58:47.975 30175 1777 Info native I0720 17:58:47.975476    1777 logger.h:28] DataSourceMetrics: CamerasInit: 19.654us
2021-07-20 17:58:47.975 30175 1777 Info native I0720 17:58:47.975517    1777 session_create_implementation_shared.cc:1166] CPU Image enable frame delay to compensate delay: false
2021-07-20 17:58:48.011 30175 1777 Info native I0720 17:58:48.011103    1777 config_helpers.cc:396] Legacy IMU sigma values are used
2021-07-20 17:58:48.013 30175 1777 Info native I0720 17:58:48.013089    1777 feature_matcher_and_filter.cc:92] Enabled the robustification to large-sized and fast-moving objects on this mono-camera device.
2021-07-20 17:58:48.015 30175 1777 Info native I0720 17:58:48.015687    1777 pose_confidence_estimator.cc:231] Pose confidence model loaded successfully
2021-07-20 17:58:48.152 30175 1777 Info native I0720 17:58:48.152246    1777 asset_manager_util.cc:59] Created global reference to asset manager.
2021-07-20 17:58:48.152 30175 1777 Info native I0720 17:58:48.152315    1777 session_create_implementation_shared.cc:1194] Normal detector created.
2021-07-20 17:58:48.177 30175 1777 Info native I0720 17:58:48.177327    1777 planar_target_tracking_manager.h:116] Config of PlanarTargetTrackingManager:
2021-07-20 17:58:48.177 30175 1777 Info native -pose_refinement_with_detection_interval_ns: 0
2021-07-20 17:58:48.177 30175 1777 Info native -min_interval_between_detections_ns: 500000000
2021-07-20 17:58:48.177 30175 1777 Info native -filter_parallax: false
2021-07-20 17:58:48.177 30175 1777 Info native -filter_result: true
2021-07-20 17:58:48.177 30175 1777 Info native -multiple_targets: true
2021-07-20 17:58:48.177 30175 1777 Info native -mini_detection: true
2021-07-20 17:58:48.177 30175 1777 Info native -tracking_mode: 1
2021-07-20 17:58:48.177 30175 1777 Info native -camera_id: 0
2021-07-20 17:58:48.190 30175 1777 Info native session_manager.cc:50 ArPresto::Session created.camera direction:0 camera preference:0
2021-07-20 17:58:48.190 30175 1777 Info native I0720 17:58:48.190258    1777 session.cc:553] Session::CheckAndWriteCurrentConfig returning OK.
2021-07-20 17:58:48.190 30175 1777 Info native I0720 17:58:48.190341    1777 session.cc:1179] Entering Session::Resume.
2021-07-20 17:58:48.191 30175 1777 Info native I0720 17:58:48.191452    1777 camera_config_manager.cc:719] UpdateBugFixes on CameraConfigManager is unimplemented!
2021-07-20 17:58:48.220 30175 1777 Info CameraManagerGlobal Connecting to camera service
2021-07-20 17:58:48.228 30175 1778 Info CameraManagerGlobal Camera 0 facing CAMERA_FACING_BACK state now CAMERA_STATE_CLOSED for client com.DefaultCompany.HandtrackingAAR API Level 2
2021-07-20 17:58:48.229 30175 1778 Info CameraManagerGlobal Camera 1 facing CAMERA_FACING_FRONT state now CAMERA_STATE_CLOSED for client com.samsung.android.biometrics.service API Level 2
2021-07-20 17:58:48.229 30175 1771 Info CameraManagerGlobal Camera 2 facing CAMERA_FACING_FRONT state now CAMERA_STATE_CLOSED for client android.system API Level 2
2021-07-20 17:58:48.229 30175 1771 Info CameraManagerGlobal Camera 20 facing CAMERA_FACING_BACK state now CAMERA_STATE_CLOSED for client com.sec.android.app.camera API Level 2
2021-07-20 17:58:48.230 30175 1777 Info native I0720 17:58:48.230606    1777 session.cc:3293] Update Frame Delay to 0 frames.
2021-07-20 17:58:48.230 30175 1777 Info native I0720 17:58:48.230908    1777 android_sensors.cc:185] Starting thread.
2021-07-20 17:58:48.231 30175 2201 Info native I0720 17:58:48.230906    2201 android_camera.cc:763] [Camera=0; State=CLOSED] Reset cleanly got to CLOSED state.
2021-07-20 17:58:48.241 30175 1777 Info native I0720 17:58:48.241013    1777 cameras.cc:1201] Included camera stream {camera_id = "0", stream_index = 0} as feature extraction streams.
2021-07-20 17:58:48.241 30175 1777 Info native I0720 17:58:48.241211    1777 logger.h:28] DataSourceMetrics: kStartImageSubSystem: 234.807us
2021-07-20 17:58:48.241 30175 1777 Info native I0720 17:58:48.241260    1777 session.cc:1367] Session::ResumeWithAnalytics returning OK.
2021-07-20 17:58:48.241 30175 1771 Info CameraManagerGlobal Camera 21 facing CAMERA_FACING_BACK state now CAMERA_STATE_CLOSED for client android.system API Level 2
2021-07-20 17:58:48.241 30175 1771 Info CameraManagerGlobal Camera 50 facing CAMERA_FACING_BACK state now CAMERA_STATE_CLOSED for client android.system API Level 2
2021-07-20 17:58:48.241 30175 1770 Info CameraManagerGlobal Camera 90 facing CAMERA_FACING_FRONT state now CAMERA_STATE_CLOSED for client com.samsung.android.biometrics.service API Level 2
2021-07-20 17:58:48.242 30175 1777 Info native session_manager.cc:314 ArPresto::Moving from ArPrestoStatus 102 to 101
2021-07-20 17:58:48.242 30175 1777 Error native E0720 17:58:48.242608    1777 session_lite_c_api.cc:153] operator(): width <= 0
2021-07-20 17:58:48.242 30175 1777 Info native I0720 17:58:48.242650    1777 session.cc:3293] Update Frame Delay to 0 frames.
2021-07-20 17:58:48.246 30175 2225 Info native I0720 17:58:48.246827    2225 android_sensors.cc:45] Gyro min delay 2ms requesting 5ms
2021-07-20 17:58:48.248 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 851980! count 0, type 3
2021-07-20 17:58:48.248 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 1638402! count 0, type 3
2021-07-20 17:58:48.248 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 1638403! count 0, type 3
2021-07-20 17:58:48.248 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 1835009! count 0, type 3
2021-07-20 17:58:48.248 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 1835010! count 0, type 3
2021-07-20 17:58:48.248 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 1638407! count 0, type 3
2021-07-20 17:58:48.248 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 1638408! count 0, type 3
2021-07-20 17:58:48.259 30175 2225 Info native I0720 17:58:48.259325    2225 android_sensors.cc:45] Accel min delay 2ms requesting 5ms
2021-07-20 17:58:48.271 30175 2226 Info CameraManagerGlobal Camera 0 facing CAMERA_FACING_BACK state now CAMERA_STATE_OPEN for client com.DefaultCompany.HandtrackingAAR API Level 2
2021-07-20 17:58:48.296 30175 2201 Info native I0720 17:58:48.296913    2201 logger.h:28] CameraMetrics: OpenCamera: 50.673731ms
2021-07-20 17:58:48.297 30175 2201 Info native I0720 17:58:48.297817    2201 camera_ndk_wrapper.cc:27] Loading Android NDK 28 symbols from libcamera2ndk.so
2021-07-20 17:58:48.298 30175 2201 Info native I0720 17:58:48.298503    2201 camera_ndk_wrapper.cc:47] Successfully loaded Android NDK 28 libcamera2ndk.so symbols.
2021-07-20 17:58:48.411 30175 2201 Info native I0720 17:58:48.410960    2201 logger.h:28] CameraMetrics: CreateCaptureSession: 112.4015ms
2021-07-20 17:58:48.411 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 851980! count 0, type 3
2021-07-20 17:58:48.411 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 1638402! count 0, type 3
2021-07-20 17:58:48.411 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 1638403! count 0, type 3
2021-07-20 17:58:48.411 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 1835009! count 0, type 3
2021-07-20 17:58:48.411 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 1835010! count 0, type 3
2021-07-20 17:58:48.411 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 1638407! count 0, type 3
2021-07-20 17:58:48.412 30175 2201 Error ACameraMetadata filterDurations: malformed duration key 1638408! count 0, type 3
2021-07-20 17:58:48.412 30175 2201 Info native I0720 17:58:48.412098    2201 capture_request_utils.cc:207] Flash: ConfigureRequestFlashMode - OFF
2021-07-20 17:58:48.414 30175 2201 Info native I0720 17:58:48.414805    2201 logger.h:28] DataSourceMetrics: kFirstGlCallback: 173.821615ms
2021-07-20 17:58:48.414 30175 2195 Info native I0720 17:58:48.414808    2195 cameras.cc:1387] Camera 0 changed state CLOSED->OPEN; Camera device opened successfully. i=0
2021-07-20 17:58:48.415 30175 2195 Info native I0720 17:58:48.414988    2195 cameras.cc:1387] Camera 0 changed state OPEN->CAPTURING; Started capture session. i=1
2021-07-20 17:58:48.415 30175 2226 Warn Gralloc3 allocator 3.x is not supported
2021-07-20 17:58:48.429 30175 1777 Info native I0720 17:58:48.429545    1777 session.cc:553] Session::CheckAndWriteCurrentConfig returning OK.
2021-07-20 17:58:48.430 30175 2201 Info native I0720 17:58:48.430146    2201 capture_request_utils.cc:207] Flash: ConfigureRequestFlashMode - OFF
2021-07-20 17:58:48.433 30175 2195 Info native I0720 17:58:48.433119    2195 cameras.cc:1387] Camera 0 changed state CAPTURING->RECONFIGURING; Changing runtime configuration... i=2
2021-07-20 17:58:48.447 30175 1777 Info native I0720 17:58:48.447198    1777 session.cc:3293] Update Frame Delay to 3 frames.
2021-07-20 17:58:48.528 30175 1777 Error native E0720 17:58:48.528872    1777 status.cc:162] FAILED_PRECONDITION: 
2021-07-20 17:58:48.528 30175 1777 Error native ARCoreError: third_party/arcore/ar/core/session.cc:3131
2021-07-20 17:58:48.528 30175 1777 Error native 
2021-07-20 17:58:48.528 30175 1777 Error native ARCoreError: vr/perception/depth/projects/motion_stereo/manager/motion_stereo_manager.cc:1946
2021-07-20 17:58:48.528 30175 1777 Error native No depth data found for the requested timestamp. [type.googleapis.com/util.ErrorSpacePayload='ArStatusErrorSpace::AR_ERROR_NOT_YET_AVAILABLE']
2021-07-20 17:58:48.597 30175 1777 Error native E0720 17:58:48.597265    1777 status.cc:162] FAILED_PRECONDITION: 
2021-07-20 17:58:48.597 30175 1777 Error native ARCoreError: third_party/arcore/ar/core/session.cc:3131
2021-07-20 17:58:48.597 30175 1777 Error native 
2021-07-20 17:58:48.597 30175 1777 Error native ARCoreError: vr/perception/depth/projects/motion_stereo/manager/motion_stereo_manager.cc:1946
2021-07-20 17:58:48.597 30175 1777 Error native No depth data found for the requested timestamp. [type.googleapis.com/util.ErrorSpacePayload='ArStatusErrorSpace::AR_ERROR_NOT_YET_AVAILABLE']
2021-07-20 17:58:48.669 30175 1777 Error native E0720 17:58:48.669094    1777 status.cc:162] FAILED_PRECONDITION: 
2021-07-20 17:58:48.669 30175 1777 Error native ARCoreError: third_party/arcore/ar/core/session.cc:3131
2021-07-20 17:58:48.669 30175 1777 Error native 
2021-07-20 17:58:48.669 30175 1777 Error native ARCoreError: vr/perception/depth/projects/motion_stereo/manager/motion_stereo_manager.cc:1946
2021-07-20 17:58:48.669 30175 1777 Error native No depth data found for the requested timestamp. [type.googleapis.com/util.ErrorSpacePayload='ArStatusErrorSpace::AR_ERROR_NOT_YET_AVAILABLE']
2021-07-20 17:58:48.738 30175 1777 Error native E0720 17:58:48.737960    1777 status.cc:162] FAILED_PRECONDITION: 
2021-07-20 17:58:48.738 30175 1777 Error native ARCoreError: third_party/arcore/ar/core/session.cc:3131
2021-07-20 17:58:48.738 30175 1777 Error native 
2021-07-20 17:58:48.738 30175 1777 Error native ARCoreError: vr/perception/depth/projects/motion_stereo/manager/motion_stereo_manager.cc:1946
2021-07-20 17:58:48.738 30175 1777 Error native No depth data found for the requested timestamp. [type.googleapis.com/util.ErrorSpacePayload='ArStatusErrorSpace::AR_ERROR_NOT_YET_AVAILABLE']
2021-07-20 17:58:48.806 30175 1770 Info CameraManagerGlobal Camera 0 facing CAMERA_FACING_BACK state now CAMERA_STATE_ACTIVE for client com.DefaultCompany.HandtrackingAAR API Level 2
2021-07-20 17:58:48.809 30175 1777 Error native E0720 17:58:48.809028    1777 status.cc:162] FAILED_PRECONDITION: 
2021-07-20 17:58:48.809 30175 1777 Error native ARCoreError: third_party/arcore/ar/core/session.cc:3131
2021-07-20 17:58:48.809 30175 1777 Error native 
2021-07-20 17:58:48.809 30175 1777 Error native ARCoreError: vr/perception/depth/projects/motion_stereo/manager/motion_stereo_manager.cc:1946
2021-07-20 17:58:48.809 30175 1777 Error native No depth data found for the requested timestamp. [type.googleapis.com/util.ErrorSpacePayload='ArStatusErrorSpace::AR_ERROR_NOT_YET_AVAILABLE']
2021-07-20 17:58:48.832 30175 2227 Info native I0720 17:58:48.832682    2227 timebase_helpers.cc:170] Timebase offset intialized to 0
2021-07-20 17:58:48.834 30175 2231 Info native I0720 17:58:48.833978    2231 logger.h:28] CameraMetrics: FirstCaptureComplete: 403.611269ms
2021-07-20 17:58:48.834 30175 2231 Info native I0720 17:58:48.834325    2231 android_camera.cc:1628] [Camera=0; State=RECONFIGURING] Camera completed repeating capture sequence 0
2021-07-20 17:58:48.834 30175 2231 Info native I0720 17:58:48.834430    2231 logger.h:28] CameraMetrics: LastCaptureComplete: 0
2021-07-20 17:58:48.834 30175 2195 Info native I0720 17:58:48.834635    2195 cameras.cc:1387] Camera 0 changed state RECONFIGURING->CAPTURING; [Camera=0; State=RECONFIGURING] Camera reconfigure complete. i=3
2021-07-20 17:58:48.834 30175 2227 Info native I0720 17:58:48.834791    2227 logger.h:28] DataSourceMetrics: kFirstImageCallback: 593.804999ms
2021-07-20 17:58:48.843 30175 1777 Error native E0720 17:58:48.843933    1777 status.cc:162] FAILED_PRECONDITION: 
2021-07-20 17:58:48.843 30175 1777 Error native ARCoreError: third_party/arcore/ar/core/session.cc:3131
2021-07-20 17:58:48.843 30175 1777 Error native 
2021-07-20 17:58:48.843 30175 1777 Error native ARCoreError: vr/perception/depth/projects/motion_stereo/manager/motion_stereo_manager.cc:1946
2021-07-20 17:58:48.843 30175 1777 Error native No depth data found for the requested timestamp. [type.googleapis.com/util.ErrorSpacePayload='ArStatusErrorSpace::AR_ERROR_NOT_YET_AVAILABLE']
2021-07-20 17:58:48.881 30175 2213 Warn native W0720 17:58:48.881163    2213 feature_matcher_and_filter_utils.cc:260] INVALID_ARGUMENT: integration window start at 0 Use identity R.
2021-07-20 17:58:48.896 30175 1777 Info Unity Creating GPU Render texture (1920x1080).
2021-07-20 17:58:48.896 30175 1777 Info Unity 
2021-07-20 17:58:48.948 30175 2217 Error native E0720 17:58:48.948652    2217 motion_tracking_context.cc:1371] Unable to find measurements corresponding to VIO status at timestamp 3124926869691238.
2021-07-20 17:58:49.050 30175 1777 Info native I20210720 17:58:49.050560  1777 asset_manager_util.cc:59] Created global reference to asset manager.
2021-07-20 17:58:49.052 30175 1777 Info mali_egl eglDestroySurface() in
2021-07-20 17:58:49.052 30175 1777 Info mali_egl eglDestroySurface() out
2021-07-20 17:58:49.053 30175 1777 Info native I20210720 17:58:49.053686  1777 gl_context_egl.cc:163] Successfully initialized EGL. Major : 1 Minor: 4
2021-07-20 17:58:49.055 30175 2290 Info native I20210720 17:58:49.055816  2290 gl_context.cc:331] GL version: 3.2 (OpenGL ES 3.2 v1.r19p0-01rel0.###other-sha0123456789ABCDEF0###)
2021-07-20 17:58:49.100 30175 1777 Info native I20210720 17:58:49.100556  1777 graph.cc:474] Start running the graph, waiting for inputs.
2021-07-20 17:58:49.100 30175 1777 Info native I20210720 17:58:49.100744  1777 gl_context_egl.cc:163] Successfully initialized EGL. Major : 1 Minor: 4
2021-07-20 17:58:49.102 30175 2302 Info native I20210720 17:58:49.102761  2302 gl_context.cc:331] GL version: 3.2 (OpenGL ES 3.2 v1.r19p0-01rel0.###other-sha0123456789ABCDEF0###)
2021-07-20 17:58:49.169 30175 2290 Info native I20210720 17:58:49.169553  2290 resource_util_android.cc:89] Successfully loaded: palm_detection.tflite
2021-07-20 17:58:49.172 30175 2290 Info tflite Initialized TensorFlow Lite runtime.
2021-07-20 17:58:49.173 30175 2290 Info tflite Created TensorFlow Lite delegate for GPU.
2021-07-20 17:58:49.173 30175 2290 Info tflite Replacing 119 node(s) with delegate (TfLiteGpuDelegate) node, yielding 1 partitions.
2021-07-20 17:58:49.295 30175 2212 Info native I0720 17:58:49.295336    2212 bundle_adjustment_initializer.cc:709] Deterministic initialization
2021-07-20 17:58:49.314 30175 2212 Info native I0720 17:58:49.314701    2212 bundle_adjustment_initializer.cc:263] Intrinsic vector size of the camera 0 is 7
2021-07-20 17:58:49.392 30175 2212 Info native I0720 17:58:49.392830    2212 bundle_adjustment_initializer.cc:466] Initializer did not converge: Maximum number of iterations reached. Number of iterations: 18.
2021-07-20 17:58:49.394 30175 2212 Info native I0720 17:58:49.394733    2212 bundle_adjustment_initialization.h:136] Number of measurements used in BA initialization for temporal landmarks: 300
2021-07-20 17:58:49.394 30175 2212 Info native I0720 17:58:49.394905    2212 bundle_adjustment_initialization.h:138] Number of good measurements (i.e., reprojection errors <= 3 pixels) in BA initialization for temporal landmarks: 291
2021-07-20 17:58:50.574 30175 2290 Info native I20210720 17:58:50.574146  2290 resource_util_android.cc:89] Successfully loaded: hand_landmark.tflite
2021-07-20 17:58:50.577 30175 2290 Info tflite Replacing 64 node(s) with delegate (TfLiteGpuDelegate) node, yielding 1 partitions.
2021-07-20 17:58:51.792 30175 2297 Info native I20210720 17:58:51.792305  2297 resource_util_android.cc:89] Successfully loaded: handedness.txt
2021-07-20 17:58:51.825 30175 1777 Error native E0720 17:58:51.825016    1777 status.cc:162] FAILED_PRECONDITION: 
2021-07-20 17:58:51.825 30175 1777 Error native ARCoreError: third_party/arcore/ar/core/session.cc:3131
2021-07-20 17:58:51.825 30175 1777 Error native 
2021-07-20 17:58:51.825 30175 1777 Error native ARCoreError: vr/perception/depth/projects/motion_stereo/manager/motion_stereo_manager.cc:1946
2021-07-20 17:58:51.825 30175 1777 Error native No depth data found for the requested timestamp. [type.googleapis.com/util.ErrorSpacePayload='ArStatusErrorSpace::AR_ERROR_NOT_YET_AVAILABLE']
2021-07-20 17:58:51.852 30175 1777 Error native E0720 17:58:51.852661    1777 status.cc:162] FAILED_PRECONDITION: 
2021-07-20 17:58:51.852 30175 1777 Error native ARCoreError: third_party/arcore/ar/core/session.cc:3131
2021-07-20 17:58:51.852 30175 1777 Error native 
2021-07-20 17:58:51.852 30175 1777 Error native ARCoreError: vr/perception/depth/projects/motion_stereo/manager/motion_stereo_manager.cc:1946
2021-07-20 17:58:51.852 30175 1777 Error native No depth data found for the requested timestamp. [type.googleapis.com/util.ErrorSpacePayload='ArStatusErrorSpace::AR_ERROR_NOT_YET_AVAILABLE']
2021-07-20 17:58:51.885 30175 1777 Error native E0720 17:58:51.885923    1777 status.cc:162] FAILED_PRECONDITION: 
2021-07-20 17:58:51.885 30175 1777 Error native ARCoreError: third_party/arcore/ar/core/session.cc:3131
2021-07-20 17:58:51.885 30175 1777 Error native 
2021-07-20 17:58:51.885 30175 1777 Error native ARCoreError: vr/perception/depth/projects/motion_stereo/manager/motion_stereo_manager.cc:1946
2021-07-20 17:58:51.885 30175 1777 Error native No depth data found for the requested timestamp. [type.googleapis.com/util.ErrorSpacePayload='ArStatusErrorSpace::AR_ERROR_NOT_YET_AVAILABLE']
2021-07-20 17:58:51.951 30175 1777 Info native session_manager.cc:314 ArPresto::Moving from ArPrestoStatus 101 to 100
2021-07-20 17:58:53.327 30175 2217 Error native E0720 17:58:53.307631    2217 motion_tracking_context.cc:1371] Unable to find measurements corresponding to VIO status at timestamp 3124931167485581.
2021-07-20 17:58:54.169 30175 1777 Info native I0720 17:58:54.169311    1777 session.cc:3293] Update Frame Delay to 1 frames.
2021-07-20 17:58:55.671 30175 1777 Info native I0720 17:58:55.671804    1777 session.cc:3293] Update Frame Delay to 3 frames.
2021-07-20 17:58:56.617 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] ViewPostIme pointer 0
2021-07-20 17:58:56.775 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] ViewPostIme pointer 1
2021-07-20 17:58:57.228 30175 1777 Info native arpresto_api.cc:46 ArPresto::ArPresto_handleActivityPause
2021-07-20 17:58:57.228 30175 1777 Info native I0720 17:58:57.228647    1777 session.cc:1580] Entering Session::Pause.
2021-07-20 17:58:57.235 30175 1777 Info native I0720 17:58:57.233168    1777 plane_manager.cc:942] PopulatePlaneEstimationStatistics  number_of_normal_segmentations: 0, number_of_plane_normal_segment_matches: 0, vertical_planes_boundary_area: 0, vertical_planes_ml_boundary_growth: 0, number_of_vertical_planes: 0, number_of_vertical_planes_with_ml_boundary_growth: 0, avg_duration_in_seconds: 0, tof_merge_quality_stats_.Empty(): true, tof_merge_quality_stats_.hist_area_overlap_ratio_: [0.750, 0.760): 0.000000, [0.760, 0.770): 0.000000, [0.770, 0.780): 0.000000, [0.780, 0.790): 0.000000, [0.790, 0.800): 0.000000, [0.800, 0.810): 0.000000, [0.810, 0.820): 0.000000, [0.820, 0.830): 0.000000, [0.830, 0.840): 0.000000, [0.840, 0.850): 0.000000, [0.850, 0.860): 0.000000, [0.860, 0.870): 0.000000, [0.870, 0.880): 0.000000, [0.880, 0.890): 0.000000, [0.890, 0.900): 0.000000, [0.900, 0.910): 0.000000, [0.910, 0.920): 0.000000, [0.920, 0.930): 0.000000, [0.930, 0.940): 0.000000, [0.940, 0.950): 0.000000, [0.950, 0.960): 0.000000, [0.960, 0.970): 0.000000, [0.970, 0.980): 0.000000, [0.980, 0.990): 0.000000, [0.990, 1.000): 0.000000, [1.000, inf): 0.000000, , tof_merge_quality_stats_.hist_feature_overlap_ratio_: [0.900, 0.905): 0.000000, [0.905, 0.910): 0.000000, [0.910, 0.915): 0.000000, [0.915, 0.920): 0.000000, [0.920, 0.925): 0.000000, [0.925, 0.930): 0.000000, [0.930, 0.935): 0.000000, [0.935, 0.940): 0.000000, [0.940, 0.945): 0.000000, [0.945, 0.950): 0.000000, [0.950, 0.955): 0.000000, [0.955, 0.960): 0.000000, [0.960, 0.965): 0.000000, [0.965, 0.970): 0.000000, [0.970, 0.975): 0.000000, [0.975, 0.980): 0.000000, [0.980, 0.985): 0.000000, [0.985, 0.990): 0.000000, [0.990, 0.995): 0.000000, [0.995, 1.000): 0.000000, [1.000, inf): 0.000000, , tof_merge_quality_stats_.hist_normal_closeness_: [0.900, 0.905): 0.000000, [0.905, 0.910): 0.000000, [0.910, 0.915): 0.000000, [0.915, 0.920): 0.000000, [0.920, 0.925): 0.000000, [0.925, 0.930): 0.000000, [0.930, 0.935): 0.000000, [0.935, 0.940): 0.000000, [0.940, 0.945): 0.000000, [0.945, 0.950): 0.000000, [0.950, 0.955): 0.000000, [0.955, 0.960): 0.000000, [0.960, 0.965): 0.000000, [0.965, 0.970): 0.000000, [0.970, 0.975): 0.000000, [0.975, 0.980): 0.000000, [0.980, 0.985): 0.000000, [0.985, 0.990): 0.000000, [0.990, 0.995): 0.000000, [0.995, 1.000): 0.000000, [1.000, inf): 0.000000, , tof_merge_quality_stats_.hist_plane_distance_: [0.000, 0.010): 0.000000, [0.010, 0.020): 0.000000, [0.020, 0.030): 0.000000, [0.030, 0.040): 0.000000, [0.040, 0.050): 0.000000, [0.050, 0.060): 0.000000, [0.060, 0.070): 0.000000, [0.070, 0.080): 0.000000, [0.080, 0.090): 0.000000, [0.090, 0.100): 0.000000, [0.100, 0.110): 0.000000, [0.110, 0.120): 0.000000, [0.120, 0.130): 0.000000, [0.130, 0.140): 0.000000, [0.140, 0.150): 0.000000, [0.150, 0.160): 0.000000, [0.160, 0.170): 0.000000, [0.170, 0.180): 0.000000, [0.180, 0.190): 0.000000, [0.190, 0.200): 0.000000, [0.200, 0.210): 0.000000, [0.210, 0.220): 0.000000, [0.220, 0.230): 0.000000, [0.230, 0.240): 0.000000, [0.240, 0.250): 0.000000, [0.250, 0.260): 0.000000, [0.260, 0.270): 0.000000, [0.270, 0.280): 0.000000, [0.280, 0.290): 0.000000, [0.290, 0.300): 0.000000, [0.300, 0.310): 0.000000, [0.310, 0.320): 0.000000, [0.320, 0.330): 0.000000, [0.330, 0.340): 0.000000, [0.340, 0.350): 0.000000, [0.350, 0.360): 0.000000, [0.360, 0.370): 0.000000, [0.370, 0.380): 0.000000, [0.380, 0.390): 0.000000, [0.390, 0.400): 0.000000, [0.400, 0.410): 0.000000, [0.410, 0.420): 0.000000, [0.420, 0.430): 0.000000, [0.430, 0.440): 0.000000, [0.440, 0.450): 0.000000, [0.450, 0.460): 0.000000, [0.460, 0.470): 0.000000, [0.470, 0.480): 0.000000, [0.480, 0.490): 0.000000, [0.490, 0.500): 0.000000, [0.500, inf): 0.000000, , ms_merge_quality_stats_.Empty(): true, ms_merge_quality_stats_.hist_area_overlap_ratio_: [0.750, 0.760): 0.000000, [0.760, 0.770): 0.000000, [0.770, 0.780): 0.000000, [0.780, 0.790): 0.000000, [0.790, 0.800): 0.000000, [0.800, 0.810): 0.000000, [0.810, 0.820): 0.000000, [0.820, 0.830): 0.000000, [0.830, 0.840): 0.000000, [0.840, 0.850): 0.000000, [0.850, 0.860): 0.000000,
2021-07-20 17:58:57.235 30175 1777 Info native I0720 17:58:57.235481    1777 online_calibration_manager.cc:164] OnlineCalibrationManager: Discarding the new online recalibration estimates.
2021-07-20 17:58:57.247 30175 2195 Info native I0720 17:58:57.247023    2195 cameras.cc:1387] Camera 0 changed state CAPTURING->STOPPING; Capture session stopping... i=4
2021-07-20 17:58:57.488 30175 1771 Error ACameraDevice onDeviceIdle sending state cb
2021-07-20 17:58:57.488 30175 2231 Info native I0720 17:58:57.488801    2231 android_camera.cc:1628] [Camera=0; State=STOPPING] Camera completed repeating capture sequence 1
2021-07-20 17:58:57.489 30175 2231 Info native I0720 17:58:57.489000    2231 logger.h:28] CameraMetrics: LastCaptureComplete: 242.01173ms
2021-07-20 17:58:57.489 30175 2307 Info CameraManagerGlobal Camera 0 facing CAMERA_FACING_BACK state now CAMERA_STATE_IDLE for client com.DefaultCompany.HandtrackingAAR API Level 2
2021-07-20 17:58:57.621 30175 1777 Info native I0720 17:58:57.621558    1777 logger.h:28] CameraMetrics: CloseCaptureSession: 132.291769ms
2021-07-20 17:58:57.621 30175 2195 Info native I0720 17:58:57.621756    2195 cameras.cc:1387] Camera 0 changed state STOPPING->OPEN; Camera stopped. i=5
2021-07-20 17:58:57.700 30175 1777 Info native I0720 17:58:57.700714    1777 logger.h:28] CameraMetrics: CloseCamera: 79.002308ms
2021-07-20 17:58:57.701 30175 2307 Info CameraManagerGlobal Camera 0 facing CAMERA_FACING_BACK state now CAMERA_STATE_CLOSED for client com.DefaultCompany.HandtrackingAAR API Level 2
2021-07-20 17:58:57.701 30175 2195 Info native I0720 17:58:57.701350    2195 cameras.cc:1387] Camera 0 changed state OPEN->CLOSED; Camera device closed successfully. i=6
2021-07-20 17:58:57.703 30175 1777 Info native I0720 17:58:57.703454    1777 logger.h:28] DataSourceMetrics: kStopImageSubSystem: 456.860846ms
2021-07-20 17:58:57.706 30175 1777 Info mali_egl eglDestroySurface() in
2021-07-20 17:58:57.706 30175 1777 Info mali_egl eglDestroySurface() out
2021-07-20 17:58:57.710 30175 1777 Error native E0720 17:58:57.710094    1777 scheduler.cc:278] generic::internal: RET_CHECK failure (third_party/mediapipe/framework/scheduler.cc:278) state_ != STATE_NOT_STARTED (0 vs. 0) 
2021-07-20 17:58:57.710 30175 1777 Error native Stack trace:
2021-07-20 17:58:57.710 30175 1777 Error native 
2021-07-20 17:58:57.710 30175 1777 Error native E0720 17:58:57.710187    1777 model_inference_cpu.cc:160] Error graph_->WaitUntilIdle():INTERNAL: RET_CHECK failure (third_party/mediapipe/framework/scheduler.cc:278) state_ != STATE_NOT_STARTED (0 vs. 0) 
2021-07-20 17:58:57.710 30175 1777 Error native E0720 17:58:57.710234    1777 scheduler.cc:278] generic::internal: RET_CHECK failure (third_party/mediapipe/framework/scheduler.cc:278) state_ != STATE_NOT_STARTED (0 vs. 0) 
2021-07-20 17:58:57.710 30175 1777 Error native Stack trace:
2021-07-20 17:58:57.710 30175 1777 Error native 
2021-07-20 17:58:57.710 30175 1777 Error native E0720 17:58:57.710265    1777 normal_detector_cpu.cc:231] Error graph_->WaitUntilIdle():INTERNAL: RET_CHECK failure (third_party/mediapipe/framework/scheduler.cc:278) state_ != STATE_NOT_STARTED (0 vs. 0) 
2021-07-20 17:58:57.710 30175 1777 Info native I0720 17:58:57.710294    1777 session.cc:1688] Session::PauseWithAnalytics returning OK.
2021-07-20 17:58:57.716 30175 1777 Info native session_manager.cc:314 ArPresto::Moving from ArPrestoStatus 100 to 102
2021-07-20 17:58:57.731 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] MSG_WINDOW_FOCUS_CHANGED 0 1
2021-07-20 17:58:57.748 30175 30175 Info SurfaceView onWindowVisibilityChanged(8) false android.view.SurfaceView{468bfed VFE...... .F....I. 0,0-1080,2220 #7f0800fe app:id/unitySurfaceView} of ViewRootImpl@a3eee04[UnityPlayerActivity]
2021-07-20 17:58:57.750 30175 30175 Info SurfaceView surfaceDestroyed callback.size 1 #2 android.view.SurfaceView{468bfed VFE...... .F....I. 0,0-1080,2220 #7f0800fe app:id/unitySurfaceView}
2021-07-20 17:58:57.753 30175 30175 Info SurfaceView remove() android.view.SurfaceView{468bfed VFE...... .F....I. 0,0-1080,2220 #7f0800fe app:id/unitySurfaceView} Surface(name=SurfaceView - com.DefaultCompany.HandtrackingAAR/com.unity3d.player.UnityPlayerActivity@468bfed@0)/@0xfb253d2
2021-07-20 17:58:57.759 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] Relayout returned: old=(0,0,1080,2220) new=(0,0,1080,2220) req=(1080,2220)8 dur=4 res=0x5 s={false 0} ch=true
2021-07-20 17:58:57.770 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] Relayout returned: old=(0,0,1080,2220) new=(0,0,1080,2220) req=(1080,2220)8 dur=5 res=0x5 s={false 0} ch=false
2021-07-20 17:58:57.779 30175 30175 Info ViewRootImpl@a3eee04[UnityPlayerActivity] stopped(true) old=false
2021-07-20 17:58:57.779 30175 30175 Info SurfaceView windowStopped(true) false android.view.SurfaceView{468bfed VFE...... .F....I. 0,0-1080,2220 #7f0800fe app:id/unitySurfaceView} of ViewRootImpl@a3eee04[UnityPlayerActivity]
2021-07-20 17:58:58.187 30175 30175 Info Process Sending signal. PID: 30175 SIG: 9

About this issue

  • Original URL
  • State: closed
  • Created 3 years ago
  • Comments: 38

Most upvoted comments

@sgowroji I solve the problem.

When using eglManager(null), texture name is differ to unity GL so graph cannot using it. EglManager(EGL14.eglGetCurrentContext()) without multithreaded rendering will be works well and got palm and landmarks.

2021-07-22 17:15:40.582 16907 26317 Verbose hand_tracking Received palm detections packet.
2021-07-22 17:15:40.582 16907 26317 Verbose hand_tracking Detection(0) count: 0
2021-07-22 17:15:40.598 16907 16907 Info ViewRootImpl@a3eee04[UnityPlayerActivity] ViewPostIme pointer 0
2021-07-22 17:15:40.651 16907 26319 Verbose hand_tracking Received palm detections packet.
2021-07-22 17:15:40.651 16907 26319 Verbose hand_tracking Detection(0) count: 0
2021-07-22 17:15:40.669 16907 26319 Verbose hand_tracking Received multi-hand landmarks packet.
2021-07-22 17:15:40.671 16907 26319 Info Unity Landmark received: {"timestamp":358+,"hands":[,{"landmarks":[,{"x":0.7619135,"y":0.4123227,"z":-7.190581E-5,"visibility":0.0,"presence":0.0}{"x":0.7428021,"y":0.5740464,"z":0.10806837,"visibility":0.0,"presence":0.0}{"x":0.69009286,"y":0.646207,"z":0.18277769,"visibility":0.0,"presence":0.0}{"x":0.6357277,"y":0.684373,"z":0.23058775,"visibility":0.0,"presence":0.0}{"x":0.5771641,"y":0.7380924,"z":0.28157365,"visibility":0.0,"presence":0.0}{"x":0.58360994,"y":0.5566467,"z":0.24451523,"visibility":0.0,"presence":0.0}{"x":0.5118232,"y":0.61680555,"z":0.31951055,"visibility":0.0,"presence":0.0}{"x":0.4751685,"y":0.6545268,"z":0.35841855,"visibility":0.0,"presence":0.0}{"x":0.44512045,"y":0.6783699,"z":0.38244715,"visibility":0.0,"presence":0.0}{"x":0.5533867,"y":0.5207953,"z":0.19142748,"visibility":0.0,"presence":0.0}{"x":0.46339217,"y":0.57411206,"z":0.2703773,"visibility":0.0,"presence":0.0}{"x":0.41236383,"y":0.61631286,"z":0.29832548,"visibility":0.0,"presence":0.0}{"x":0.36990678,"y":0.6418382,"z":0.318629 ...

But i don’t know why there’s no error even GL context does not have that texture.

+2
rrrfffrrr on Jul 22, 2021

@rrrfffrrr Could you share how to build the “mediapipe_hand_tracking.aar” which is located at Android\mediapipe_hand_tracking\mediapipe_hand_tracking.aar ?

When using “mediapipe_hand_tracking.aar” which was built according to https://developers.google.com/mediapipe/framework/getting_started/android_archive_library,

mediapipe\examples\android\src\java\com\google\mediapipe\apps\aar_example\BUILD
load("//mediapipe/java/com/google/mediapipe:mediapipe_aar.bzl", "mediapipe_aar")

mediapipe_aar(
    name = "mediapipe_hand_tracking",
    calculators = ["//mediapipe/graphs/hand_tracking:mobile_calculators"],
)

bazel build -c opt --strip=ALWAYS --host_crosstool_top=@bazel_tools//tools/cpp:toolchain --fat_apk_cpu=arm64-v8a,armeabi-v7a --legacy_whole_archive=0 --features=-legacy_whole_archive --copt=-fvisibility=hidden --copt=-ffunction-sections --copt=-fdata-sections --copt=-fstack-protector --copt=-Oz --copt=-fomit-frame-pointer --copt=-DABSL_MIN_LOG_LEVEL=2 --linkopt=-Wl,--gc-sections,--strip-all //mediapipe/examples/android/src/java/com/google/mediapipe/apps/aar_example:mediapipe_hand_tracking.aar then aar file (mediapipe_hand_tracking.aar) is generated at /mediapipe/bazel-bin/mediapipe/examples/android/src/java/com/google/mediapipe/apps/aar_example/mediapipe_hand_tracking.aar

bazel build -c opt mediapipe/graphs/hand_tracking:hand_tracking_mobile_gpu_binary_graph then graph binary file (hand_tracking_mobile_gpu.binarypb) is generated at /mediapipe/bazel-bin/mediapipe/graphs/hand_tracking/hand_tracking_mobile_gpu.binarypb

After replacing the Android\mediapipe_hand_tracking\mediapipe_hand_tracking.aar and Android\app\src\main\assets\hand_tracking_mobile_gpu.binarypb in the Android Studio, The AAR Wrapper (mediapipe_hand_tracking_wrapper.aar) was generated at Android Studio (Gradle > Tasks > Other > assembleRelease).

Using rebuilt aar and aar wrapper (mediapipe_hand_tracking.aar, mediapipe_hand_tracking_wrapper.aar), the Unity app (HandtrackingForUnity-Example) runs crash.


2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH: ABI: 'arm64'
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH: Timestamp: 2023-03-27 19:06:38+0900
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH: pid: 31490, tid: 31650, name: mediapipe/31650  >>> com.DefaultCompany.Mediapipeexample <<<
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH: uid: 10404
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH: signal 11 (SIGSEGV), code 1 (SEGV_MAPERR), fault addr 0x0
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH: Cause: null pointer dereference
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:     x0  0000000000000000  x1  00000072f6156164  x2  0000006e37e6f798  x3  0000000000000020
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:     x4  0000000000000000  x5  b400007052412917  x6  20646c756f63203b  x7  6461657220746f6e
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:     x8  0101010101010101  x9  b4000070923c6170  x10 000000000000000b  x11 000000000000000b
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:     x12 b4000070224699e1  x13 0000006ea4f4d665  x14 000000000000000b  x15 000000000000004d
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:     x16 0000006ea51c7a30  x17 00000072f60cd3b0  x18 0000006e366ca000  x19 0000006e37e6f878
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:     x20 0000006e37e6f898  x21 0000000000000000  x22 ffffffffffffffff  x23 0000006e37e6f7e0
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:     x24 0000006ea4f45fff  x25 0000000000000030  x26 0000000000000036  x27 0000006f91bbc000
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:     x28 0000006e37d77000  x29 0000006e37e6fc70
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:     sp  0000006e37e6f7d0  lr  0000006ea4ac0a5c  pc  00000072f60cd3c0
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH: backtrace:
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:       #00 pc 000000000004a3c0  /apex/com.android.runtime/lib64/bionic/libc.so (strlen_default+16) (BuildId: ed02128210779eca49f45ab4dd2df2aa)
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:       #01 pc 000000000016ca58  /data/app/~~mZJt4SF-0IeBbCOpaAr4aQ==/com.DefaultCompany.Mediapipeexample-nPuKH9bd1LHnrvySOhpRjw==/lib/arm64/libmediapipe_jni.so (mediapipe::PathToResourceAsFile(std::__ndk1::basic_string<char, std::__ndk1::char_traits<char>, std::__ndk1::allocator<char> > const&)+216)
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:       #02 pc 000000000013db04  /data/app/~~mZJt4SF-0IeBbCOpaAr4aQ==/com.DefaultCompany.Mediapipeexample-nPuKH9bd1LHnrvySOhpRjw==/lib/arm64/libmediapipe_jni.so (mediapipe::LocalFileContentsCalculator::Open(mediapipe::CalculatorContext*)+192)
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:       #03 pc 000000000049c22c  /data/app/~~mZJt4SF-0IeBbCOpaAr4aQ==/com.DefaultCompany.Mediapipeexample-nPuKH9bd1LHnrvySOhpRjw==/lib/arm64/libmediapipe_jni.so (mediapipe::CalculatorNode::OpenNode()+432)
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:       #04 pc 0000000000490080  /data/app/~~mZJt4SF-0IeBbCOpaAr4aQ==/com.DefaultCompany.Mediapipeexample-nPuKH9bd1LHnrvySOhpRjw==/lib/arm64/libmediapipe_jni.so (mediapipe::internal::SchedulerQueue::OpenCalculatorNode(mediapipe::CalculatorNode*)+160)
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:       #05 pc 000000000048fefc  /data/app/~~mZJt4SF-0IeBbCOpaAr4aQ==/com.DefaultCompany.Mediapipeexample-nPuKH9bd1LHnrvySOhpRjw==/lib/arm64/libmediapipe_jni.so (mediapipe::internal::SchedulerQueue::RunNextTask()+100)
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:       #06 pc 00000000004b096c  /data/app/~~mZJt4SF-0IeBbCOpaAr4aQ==/com.DefaultCompany.Mediapipeexample-nPuKH9bd1LHnrvySOhpRjw==/lib/arm64/libmediapipe_jni.so (mediapipe::ThreadPool::RunWorker()+124)
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:       #07 pc 00000000004b06d4  /data/app/~~mZJt4SF-0IeBbCOpaAr4aQ==/com.DefaultCompany.Mediapipeexample-nPuKH9bd1LHnrvySOhpRjw==/lib/arm64/libmediapipe_jni.so (mediapipe::ThreadPool::WorkerThread::ThreadBody(void*)+796)
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:       #08 pc 00000000000b4fb4  /apex/com.android.runtime/lib64/bionic/libc.so (__pthread_start(void*)+64) (BuildId: ed02128210779eca49f45ab4dd2df2aa)
2023-03-27 19:06:38.513 31490-31650/com.DefaultCompany.Mediapipeexample E/CRASH:       #09 pc 000000000004fb64  /apex/com.android.runtime/lib64/bionic/libc.so (__start_thread+64) (BuildId: ed02128210779eca49f45ab4dd2df2aa)

I’m sorry but i lost my aar build environment. But it seems you did well but something went wrong. Can you check additional files like tensorflow or the others?

+1
rrrfffrrr on Mar 28, 2023

@rrrfffrrr When will you share the simple sample which is working ?

Im sorry im not on computer Can you waiting for me? I can give u in sunday

+1
rrrfffrrr on Mar 21, 2023
Read more comments on GitHub
← mediapipe: Generate[FAIL]: 0.2356s [Details]: General failure: Failed to resolve labels
mediapipe: ImageSegmenter creation from Web Worker hangs on iOS →