TestrunEnd shows PASS even though one of steps returned failure

[inderpreet-grang-wdc]

As part of ocp-diag-core-python, I created a test script per README file and when I run it, the fan speed was not OK yet the overall status is PASS. Any ideas why>?

python test.py
{"schemaVersion": {"major": 2, "minor": 0}, "sequenceNumber": 0, "timestamp": "2024-11-04T07:40:27.754335Z"}
{"testRunArtifact": {"testRunStart": {"name": "simple_diagnosis", "version": "1.0", "commandLine": "", "parameters": {}, "dutInfo": {"dutInfoId": "server0", "name": "server0.domain.net", "platformInfos": [], "softwareInfos": [], "hardwareInfos": []}}}, "sequenceNumber": 1, "timestamp": "2024-11-04T07:40:27.754335Z"}
{"testStepArtifact": {"testStepId": "0", "testStepStart": {"name": "check_fanspeed"}}, "sequenceNumber": 2, "timestamp": "2024-11-04T07:40:27.754335Z"}
{"testStepArtifact": {"testStepId": "0", "diagnosis": {"verdict": "fan_low", "type": "FAIL", "sourceLocation": {"file": "C:\Users\OCP\ocp-diag-core-python\test.py", "line": 16}}}, "sequenceNumber": 3, "timestamp": "2024-11-04T07:40:27.754335Z"}
{"testStepArtifact": {"testStepId": "0", "testStepEnd": {"status": "COMPLETE"}}, "sequenceNumber": 4, "timestamp": "2024-11-04T07:40:27.754335Z"}
{"testRunArtifact": {"testRunEnd": {"status": "COMPLETE", "result": "PASS"}}, "sequenceNumber": 5, "timestamp": "2024-11-04T07:40:27.754335Z"}

[mimir-d]

Hi @inderpreet-grang-wdc, thanks for your question. This is basically the same as #10, which I've just replied to (..very late reply), so I'm closing this item deferring to that.