Description
Feature Area
Other
Test Case
TC-AVSUM-2.2, 2.3, 24
Reproduction steps
While validating the TC-AVSUM-2.3 test case, we observed that Step 28 is being skipped regardless of the PIXIT.CANBEMADEBUSY condition(If set to true and false).
Even when running the test with the following argument:
--bool-arg PIXIT.CANBEMADEBUSY:1
the step that is conditionally dependent on this PIXIT (Step 28) is still skipped, which is unexpected.
Additionally, the same behavior is observed with
--bool-arg PIXIT.CANBEMADEBUSY:0
This behavior is expected.
This suggests that the conditional logic in the script responsible for evaluating PIXIT.CANBEMADEBUSY may not be functioning as intended.
Expected Behavior:
When PIXIT.CANBEMADEBUSY is true (1), Step 28 should be executed.
When PIXIT.CANBEMADEBUSY is false (0), Step 28 should be skipped.
Bug prevalence
Whenever I do this
GitHub hash of the SDK that was being used
Platform
raspi
Anything else?
1.Sample app used to run the Test : ./chip-camera-app
- Command used to run the Test case by setting the --bool-arg PIXIT.CANBEMADEBUSY:1
python3 TC_AVSUM_2_3.py --commissioning-method on-network --discriminator 3840 --passcode 20202021 --storage-path admin_storage.json --endpoint 1 --bool-arg PIXIT.CANBEMADEBUSY:1
[MatterTest] 07-09 12:57:25.140 INFO ***** Test Step 27 : If PIXIT.CANBEMADEBUSY is set, place the DUT into a state where it cannot accept a command. Else end the test cse.
[MatterTest] 07-09 12:57:25.141 INFO ***** Test Step 27 : If PIXIT.CANBEMADEBUSY is set, place the DUT into a state where it cannot accept a command. Else end the test cse.
[MatterTest] 07-09 12:57:25.143 INFO ***** Test Step 28 : Send an MPTZRelativeMove Command with any previously set relative value. Verify busy failure response.
[MatterTest] 07-09 12:57:25.145 INFO ***** Test Step 28 : Send an MPTZRelativeMove Command with any previously set relative value. Verify busy failure response.
[MatterTest] 07-09 12:57:25.146 INFO **** Skipping: 28
[MatterTest] 07-09 12:57:25.146 INFO **** Skipping: 28
[MatterTest] 07-09 12:57:25.149 INFO Finished test in 3335235.0ms
[MatterTest] 07-09 12:57:25.150 INFO [Test] test_TC_AVSUM_2_3 PASS
Reference logs:
- Command used to run the Test case by setting the --bool-arg PIXIT.CANBEMADEBUSY:0
python3 TC_AVSUM_2_3.py --commissioning-method on-network --discriminator 3840 --passcode 20202021 --storage-path admin_storage.json --endpoint 1 --bool-arg PIXIT.CANBEMADEBUSY:0
tterTest] 07-09 13:19:50.299 INFO ***** Test Step 27 : If PIXIT.CANBEMADEBUSY is set, place the DUT into a state where it cannot accept a command. Else end the test cse.
[MatterTest] 07-09 13:19:50.300 INFO ***** Test Step 28 : Send an MPTZRelativeMove Command with any previously set relative value. Verify busy failure response.
[MatterTest] 07-09 13:19:50.301 INFO ***** Test Step 28 : Send an MPTZRelativeMove Command with any previously set relative value. Verify busy failure response.
[MatterTest] 07-09 13:19:50.303 INFO **** Skipping: 28
[MatterTest] 07-09 13:19:50.304 INFO **** Skipping: 28
Reference logs:
Debug:
Same Issue faced in the TC-AVSUM-2.2 python script at test step 10 , Modified the script in line 159, --bool-arg PIXIT.CANBEMADEBUSY:1 is converted to lowercase keys inside self.user_params.
canbemadebusy = self.user_params.get("PIXIT.CANBEMADEBUSY", False)
to
canbemadebusy = self.user_params.get("pixit.canbemadebusy", False)
When we set to --bool-arg PIXIT.CANBEMADEBUSY:1 , Test step is executing as expected.
[MatterTest] 07-09 13:27:53.660 INFO ***** Test Step 9 : If PIXIT.CANBEMADEBUSY is set, place the DUT into a state where it cannot accept a command. Else jump to step 11.
[MatterTest] 07-09 13:27:53.662 INFO ***** Test Step 9 : If PIXIT.CANBEMADEBUSY is set, place the DUT into a state where it cannot accept a command. Else jump to step 11.
canbemadebusy:True
{'pixit.canbemadebusy': True, 'meta_config': {'storage_path': PosixPath('admin_storage.json'), 'logs_path': PosixPath('/tmp/matter_testing/logs'), 'paa_trust_store_path': PosixPath('/home/ubuntu/master_jun/connectedhomeip/credentials/development/paa-root-certs'), 'ble_controller': None, 'commission_only': False, 'admin_vendor_id': 65521, 'case_admin_subject': 112233, 'tests': [], 'timeout': None, 'endpoint': 1, 'app_pid': 0, 'pipe_name': None, 'fail_on_skipped_tests': False, 'commissioning_method': 'on-network', 'in_test_commissioning_method': None, 'discriminators': [3840], 'setup_passcodes': [20202021], 'commissionee_ip_address_just_for_testing': None, 'maximize_cert_chains': True, 'qr_code_content': [], 'manual_code': [], 'wifi_ssid': None, 'wifi_passphrase': None, 'thread_operational_dataset': None, 'pics': {}, 'dut_node_ids': [305414945], 'controller_node_id': 112233, 'controller_cat_tags': [65537], 'fabric_id': 1, 'root_of_trust_index': 1, 'chip_tool_credentials_path': None, 'trace_to': [], 'tc_version_to_simulate': None, 'tc_user_response_to_simulate': None, 'dac_revocation_set_path': None, 'legacy': False}, 'matter_stack': '804798a1-5cc8-11f0-a379-e45f0149ae29', 'default_controller': '80c35795-5cc8-11f0-be21-e45f0149ae29', 'matter_test_config': '80c35d95-5cc8-11f0-83f5-e45f0149ae29', 'hooks': '80c3630a-5cc8-11f0-b7c5-e45f0149ae29', 'certificate_authority_manager': '80c36628-5cc8-11f0-8c3c-e45f0149ae29'}
[MatterTest] 07-09 13:27:53.665 INFO ***** Test Step 10 : Send an MPTZSetPositionCommand with the previously set Pan value. Verify failure response.
[MatterTest] 07-09 13:27:53.666 INFO ***** Test Step 10 : Send an MPTZSetPositionCommand with the previously set Pan value. Verify failure response.
[MatterTest] 07-09 13:27:53.666 INFO ========= USER PROMPT for Endpoint 1 =========
[MatterTest] 07-09 13:27:53.667 INFO >>> Place device into a busy state. Hit ENTER once ready. (press enter to confirm)
Metadata
Metadata
Assignees
Labels
Type
Projects
Status