openvino: [Good first issue] [API CONFORMANCE] [CPU PLUGIN] Support unsupported property OPTIMAL_BATCH_SIZE in CPU plugin

Description:

API conformance suite is OV validation tool checks a plugin conditions from API implementation perspective. ov_plugin/OVCheckMetricsPropsTests_ModelDependceProps.ChangeCorrectDeviceProperties/target_device=CPU_properties=* fails on CPU Plugin

Unsupported properties:

RO (ReadOnly):

  • OPTIMAL_BATCH_SIZE

How to reproduce:

  1. Build the OV using -DENABLE_TESTS=ON -DENABLE_FUNACTIONAL_TESTS=ON -DENABLE_INTEL_CPU=ON
  2. Build ov_api_conformance_tests target
 ./ov_api_conformance_tests --gtest_filter="ov_plugin/OVCheckMetricsPropsTests_ModelD
ependceProps.ChangeCorrectDeviceProperties/target_device=CPU_properties={OPTIMAL_BATCH_SIZE*"
Note: Google Test filter = ov_plugin/OVCheckMetricsPropsTests_ModelDependceProps.ChangeCorrectDeviceProperties/target_device=CPU_properties={OPTIM
AL_BATCH_SIZE*
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from ov_plugin/OVCheckMetricsPropsTests_ModelDependceProps
[ RUN      ] ov_plugin/OVCheckMetricsPropsTests_ModelDependceProps.ChangeCorrectDeviceProperties/target_device=CPU_properties={OPTIMAL_BATCH_SIZE:
}

MEM_USAGE=47184KB
[ CONFORMANCE ] Influence coefficient: 0
src/tests/functional/plugin/shared/src/behavior/ov_plugin/properties_tests.cpp:456: Failure
Value of: supported
  Actual: false
Expected: true
property is not supported: MODEL_PTR
[  FAILED  ] ov_plugin/OVCheckMetricsPropsTests_ModelDependceProps.ChangeCorrectDeviceProperties/target_device=CPU_properties={OPTIMAL_BATCH_SIZE:
}, where GetParam() = ("CPU", { ("OPTIMAL_BATCH_SIZE", ) }) (5 ms)
[----------] 1 test from ov_plugin/OVCheckMetricsPropsTests_ModelDependceProps (5 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test suite ran. (5 ms total)
[  PASSED  ] 0 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] ov_plugin/OVCheckMetricsPropsTests_ModelDependceProps.ChangeCorrectDeviceProperties/target_device=CPU_properties={OPTIMAL_BATCH_SIZE:
}, where GetParam() = ("CPU", { ("OPTIMAL_BATCH_SIZE", ) })

 1 FAILED TEST

How to fix

support OPTIMAL_BATCH_SIZE in CPU plugin, set 1 as the default value, return the default value. Example PR https://github.com/openvinotoolkit/openvino/pull/22007

Useful links:

Contacts:

About this issue

  • Original URL
  • State: open
  • Created 6 months ago
  • Comments: 22 (19 by maintainers)

Most upvoted comments

@p-wysocki Yes I have code ready. Sorry due to some other work couldn’t complete it. This weekend I will push it.

Hi @yuxu42 yes I am working on it.