Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add raftkeeper robot to generate test report #357

Merged
merged 3 commits into from
Sep 20, 2024

Conversation

JackyWoo
Copy link
Contributor

@JackyWoo JackyWoo commented Sep 12, 2024

Which issues of this PR fixes:

This PR try to fix #358

Change log:

  1. Add raftkeeper-robot who will send test report to PR page
  2. Stop Github actions when new commit submitted.
  3. Split unit and integration tests
  4. Make depnency of different jobs.

@JackyWoo JackyWoo force-pushed the make_ci_more_intuitive branch 7 times, most recently from 0bd63df to 3f386fe Compare September 12, 2024 10:39
@JackyWoo JackyWoo added this to the Release v2.2.0 milestone Sep 12, 2024
@JackyWoo JackyWoo added the code refactor Code refactor label Sep 12, 2024
@raftkeeper-robot
Copy link

raftkeeper-robot bot commented Sep 14, 2024

Classname Name Time Successful Error Message
RaftLog writeAndReadUInt32 0. No /home/runner/work/RaftKeeper/RaftKeeper/src/Service/tests/gtest_raft_log.cpp:36
Expected equality of these values:
x1
Which is: 25
y1 + 1
Which is: 26
Successful Test Cases
Classname Name Time Successful Error Message
OperatorsManipTest EscapingTest 0. Yes
OperatorsManipTest QuouteTest 0. Yes
OperatorsManipTest DoubleQuouteTest 0. Yes
OperatorsManipTest binary 0. Yes
Logger Log 0. Yes
Common PODArrayInsert 0. Yes
Common PODPushBackRawMany 0. Yes
Common PODNoOverallocation 0.029 Yes
Common PODInsertElementSizeNotMultipleOfLeftPadding 0.026 Yes
Common unescapeForFileName 0. Yes
ShellCommand Execute 0.003 Yes
ShellCommand ExecuteDirect 0.003 Yes
ShellCommand ExecuteWithInput 0.003 Yes
ShellCommand AutoWait 3.148 Yes
ThreadPool ConcurrentWait 0.063 Yes
ThreadPool GlobalFull1 0.01 Yes
ThreadPool GlobalFull2 0.001 Yes
ThreadPool ThreadRemoval 0.002 Yes
ThreadPool Loop 0.309 Yes
ThreadPool ExceptionFromSchedule 0.01 Yes
RaftLog serializeStr 0. Yes
RaftLog serializeRaw 0. Yes
RaftLog serializeEntry 0. Yes
RaftLog parseLogEntrybody 0. Yes
RaftLog appendEntry 0. Yes
RaftLog appendEntries 0. Yes
RaftLog loadLog 0. Yes
RaftLog splitSegment 0. Yes
RaftLog removeSegment 0. Yes
RaftLog truncateLog 0.001 Yes
RaftLog writeAt 0.028 Yes
RaftLog compact 0.011 Yes
RaftLog getEntry 0. Yes
RaftLog getEntries 0. Yes
RaftPerformance appendLogPerformance 0.434 Yes
RaftPerformance appendLogThread 0.959 Yes
RaftPerformance machineCreate 1.019 Yes
RaftSnapshot parseAndSerializeKeeperNode 0. Yes
RaftSnapshot createSnapshot_1 0.004 Yes
RaftSnapshot createSnapshot_2 0.045 Yes
RaftSnapshot readAndSaveSnapshot 0.046 Yes
RaftSnapshot parseSnapshot 7.965 Yes
RaftSnapshot createSnapshotWithFuzzyLog 5.293 Yes
RaftStateMachine serializeAndParse 0. Yes
RaftStateMachine appendEntry 1. Yes
RaftStateMachine modifyEntry 1. Yes
RaftStateMachine createSnapshot 2.001 Yes
RaftStateMachine syncSnapshot 1.006 Yes
RaftStateMachine initStateMachine 3.212 Yes
RaftStateManager load_srv_state 0. Yes

@JDRaftKeeper JDRaftKeeper deleted a comment from raftkeeper-robot bot Sep 14, 2024
@JDRaftKeeper JDRaftKeeper deleted a comment from raftkeeper-robot bot Sep 14, 2024
@JDRaftKeeper JDRaftKeeper deleted a comment from raftkeeper-robot bot Sep 14, 2024
@JackyWoo JackyWoo force-pushed the make_ci_more_intuitive branch from 1b25541 to 0b12e52 Compare September 14, 2024 09:17
@JackyWoo
Copy link
Contributor Author

❌ ✅

@raftkeeper-robot
Copy link

{report_title}

Classname Name Time Successful Error Message
test_auth.test test_digest_auth_basic[get_genuine_zk] 0.050 No AssertionError: assert b'data' != b'data'
test_auth.test test_digest_auth_basic[get_fake_zk] 0.009 No AssertionError: assert b'data' != b'data'
Successful Test Cases
Classname Name Time Successful Error Message
test_auth.test test_no_auth[get_genuine_zk] 0.053 Yes
test_auth.test test_no_auth[get_fake_zk] 0.115 Yes
test_auth.test test_super_auth 0.118 Yes
test_auth.test test_digest_auth_multiple[get_genuine_zk] 0.048 Yes
test_auth.test test_digest_auth_multiple[get_fake_zk] 0.315 Yes
test_auth.test test_partial_auth[get_genuine_zk] 0.035 Yes
test_auth.test test_partial_auth[get_fake_zk] 0.120 Yes
test_auth.test test_bad_auth 0.161 Yes
test_auth.test test_auth_snapshot 7.294 Yes
test_auth.test test_get_set_acl[get_genuine_zk] 0.032 Yes
test_auth.test test_get_set_acl[get_fake_zk] 0.218 Yes

@raftkeeper-robot
Copy link

{report_title}

Classname Name Time Successful Error Message
RaftLog writeAndReadUInt32 0. No /home/runner/work/RaftKeeper/RaftKeeper/src/Service/tests/gtest_raft_log.cpp:36
Expected equality of these values:
x1
Which is: 25
y1 + 1
Which is: 26
Successful Test Cases
Classname Name Time Successful Error Message
OperatorsManipTest EscapingTest 0. Yes
OperatorsManipTest QuouteTest 0. Yes
OperatorsManipTest DoubleQuouteTest 0. Yes
OperatorsManipTest binary 0. Yes
Logger Log 0. Yes
Common PODArrayInsert 0. Yes
Common PODPushBackRawMany 0. Yes
Common PODNoOverallocation 0.001 Yes
Common PODInsertElementSizeNotMultipleOfLeftPadding 0.003 Yes
Common unescapeForFileName 0. Yes
ShellCommand Execute 0. Yes
ShellCommand ExecuteDirect 0.001 Yes
ShellCommand ExecuteWithInput 0.001 Yes
ShellCommand AutoWait 0.628 Yes
ThreadPool ConcurrentWait 0.063 Yes
ThreadPool GlobalFull1 0. Yes
ThreadPool GlobalFull2 0.012 Yes
ThreadPool ThreadRemoval 0.001 Yes
ThreadPool Loop 0.158 Yes
ThreadPool ExceptionFromSchedule 0.01 Yes
RaftLog serializeStr 0. Yes
RaftLog serializeRaw 0. Yes
RaftLog serializeEntry 0. Yes
RaftLog parseLogEntrybody 0. Yes
RaftLog appendEntry 0. Yes
RaftLog appendEntries 0. Yes
RaftLog loadLog 0. Yes
RaftLog splitSegment 0. Yes
RaftLog removeSegment 0. Yes
RaftLog truncateLog 0. Yes
RaftLog writeAt 0. Yes
RaftLog compact 0. Yes
RaftLog getEntry 0. Yes
RaftLog getEntries 0. Yes
RaftPerformance appendLogPerformance 0.104 Yes
RaftPerformance appendLogThread 0.679 Yes
RaftPerformance machineCreate 1.004 Yes
RaftSnapshot parseAndSerializeKeeperNode 0. Yes
RaftSnapshot createSnapshot_1 0. Yes
RaftSnapshot createSnapshot_2 0.004 Yes
RaftSnapshot readAndSaveSnapshot 0.005 Yes
RaftSnapshot parseSnapshot 6.233 Yes
RaftSnapshot createSnapshotWithFuzzyLog 5.265 Yes
RaftStateMachine serializeAndParse 0. Yes
RaftStateMachine appendEntry 0.1 Yes
RaftStateMachine modifyEntry 1. Yes
RaftStateMachine createSnapshot 2. Yes
RaftStateMachine syncSnapshot 2.004 Yes
RaftStateMachine initStateMachine 3.204 Yes
RaftStateManager load_srv_state 0. Yes

@raftkeeper-robot
Copy link

{report_title}

Classname Name Time Successful Error Message
test_auth.test test_digest_auth_basic[get_genuine_zk] 0.050 No AssertionError: assert b'data' != b'data'
test_auth.test test_digest_auth_basic[get_fake_zk] 0.009 No AssertionError: assert b'data' != b'data'
Successful Test Cases
Classname Name Time Successful Error Message
test_auth.test test_no_auth[get_genuine_zk] 0.053 Yes
test_auth.test test_no_auth[get_fake_zk] 0.115 Yes
test_auth.test test_super_auth 0.118 Yes
test_auth.test test_digest_auth_multiple[get_genuine_zk] 0.048 Yes
test_auth.test test_digest_auth_multiple[get_fake_zk] 0.315 Yes
test_auth.test test_partial_auth[get_genuine_zk] 0.035 Yes
test_auth.test test_partial_auth[get_fake_zk] 0.120 Yes
test_auth.test test_bad_auth 0.161 Yes
test_auth.test test_auth_snapshot 7.294 Yes
test_auth.test test_get_set_acl[get_genuine_zk] 0.032 Yes
test_auth.test test_get_set_acl[get_fake_zk] 0.218 Yes

1 similar comment
@raftkeeper-robot
Copy link

{report_title}

Classname Name Time Successful Error Message
test_auth.test test_digest_auth_basic[get_genuine_zk] 0.050 No AssertionError: assert b'data' != b'data'
test_auth.test test_digest_auth_basic[get_fake_zk] 0.009 No AssertionError: assert b'data' != b'data'
Successful Test Cases
Classname Name Time Successful Error Message
test_auth.test test_no_auth[get_genuine_zk] 0.053 Yes
test_auth.test test_no_auth[get_fake_zk] 0.115 Yes
test_auth.test test_super_auth 0.118 Yes
test_auth.test test_digest_auth_multiple[get_genuine_zk] 0.048 Yes
test_auth.test test_digest_auth_multiple[get_fake_zk] 0.315 Yes
test_auth.test test_partial_auth[get_genuine_zk] 0.035 Yes
test_auth.test test_partial_auth[get_fake_zk] 0.120 Yes
test_auth.test test_bad_auth 0.161 Yes
test_auth.test test_auth_snapshot 7.294 Yes
test_auth.test test_get_set_acl[get_genuine_zk] 0.032 Yes
test_auth.test test_get_set_acl[get_fake_zk] 0.218 Yes

@raftkeeper-robot
Copy link

{report_title}

Classname Name Time Successful Error Message
RaftLog writeAndReadUInt32 0. No /home/runner/work/RaftKeeper/RaftKeeper/src/Service/tests/gtest_raft_log.cpp:36
Expected equality of these values:
x1
Which is: 25
y1 + 1
Which is: 26
Successful Test Cases
Classname Name Time Successful Error Message
OperatorsManipTest EscapingTest 0. Yes
OperatorsManipTest QuouteTest 0. Yes
OperatorsManipTest DoubleQuouteTest 0. Yes
OperatorsManipTest binary 0. Yes
Logger Log 0. Yes
Common PODArrayInsert 0. Yes
Common PODPushBackRawMany 0. Yes
Common PODNoOverallocation 0.013 Yes
Common PODInsertElementSizeNotMultipleOfLeftPadding 0.02 Yes
Common unescapeForFileName 0. Yes
ShellCommand Execute 0.005 Yes
ShellCommand ExecuteDirect 0.004 Yes
ShellCommand ExecuteWithInput 0.005 Yes
ShellCommand AutoWait 4.089 Yes
ThreadPool ConcurrentWait 0.066 Yes
ThreadPool GlobalFull1 0.006 Yes
ThreadPool GlobalFull2 0.013 Yes
ThreadPool ThreadRemoval 0.003 Yes
ThreadPool Loop 0.407 Yes
ThreadPool ExceptionFromSchedule 0.01 Yes
RaftLog serializeStr 0. Yes
RaftLog serializeRaw 0. Yes
RaftLog serializeEntry 0. Yes
RaftLog parseLogEntrybody 0. Yes
RaftLog appendEntry 0. Yes
RaftLog appendEntries 0. Yes
RaftLog loadLog 0. Yes
RaftLog splitSegment 0.001 Yes
RaftLog removeSegment 0. Yes
RaftLog truncateLog 0.001 Yes
RaftLog writeAt 0.005 Yes
RaftLog compact 0.005 Yes
RaftLog getEntry 0.001 Yes
RaftLog getEntries 0. Yes
RaftPerformance appendLogPerformance 0.606 Yes
RaftPerformance machineCreate 1.033 Yes
RaftSnapshot parseAndSerializeKeeperNode 0. Yes
RaftSnapshot createSnapshot_1 0.001 Yes
RaftSnapshot createSnapshot_2 0.033 Yes
RaftSnapshot readAndSaveSnapshot 0.034 Yes
RaftSnapshot parseSnapshot 7.661 Yes
RaftSnapshot createSnapshotWithFuzzyLog 5.285 Yes
RaftStateMachine serializeAndParse 0. Yes
RaftStateMachine appendEntry 0.1 Yes
RaftStateMachine modifyEntry 1. Yes
RaftStateMachine createSnapshot 2.001 Yes
RaftStateMachine syncSnapshot 1.107 Yes
RaftStateMachine initStateMachine 3.214 Yes
RaftStateManager load_srv_state 0. Yes

@raftkeeper-robot
Copy link

{report_title}

Classname Name Time Successful Error Message
test_auth.test test_digest_auth_basic[get_genuine_zk] 0.050 No AssertionError: assert b'data' != b'data'
test_auth.test test_digest_auth_basic[get_fake_zk] 0.009 No AssertionError: assert b'data' != b'data'
Successful Test Cases
Classname Name Time Successful Error Message
test_auth.test test_no_auth[get_genuine_zk] 0.053 Yes
test_auth.test test_no_auth[get_fake_zk] 0.115 Yes
test_auth.test test_super_auth 0.118 Yes
test_auth.test test_digest_auth_multiple[get_genuine_zk] 0.048 Yes
test_auth.test test_digest_auth_multiple[get_fake_zk] 0.315 Yes
test_auth.test test_partial_auth[get_genuine_zk] 0.035 Yes
test_auth.test test_partial_auth[get_fake_zk] 0.120 Yes
test_auth.test test_bad_auth 0.161 Yes
test_auth.test test_auth_snapshot 7.294 Yes
test_auth.test test_get_set_acl[get_genuine_zk] 0.032 Yes
test_auth.test test_get_set_acl[get_fake_zk] 0.218 Yes

@raftkeeper-robot
Copy link

{report_title}

Classname Name Time Successful Error Message
RaftLog writeAndReadUInt32 0. No /home/runner/work/RaftKeeper/RaftKeeper/src/Service/tests/gtest_raft_log.cpp:36
Expected equality of these values:
x1
Which is: 25
y1 + 1
Which is: 26
Successful Test Cases
Classname Name Time Successful Error Message
OperatorsManipTest EscapingTest 0. Yes
OperatorsManipTest QuouteTest 0. Yes
OperatorsManipTest DoubleQuouteTest 0. Yes
OperatorsManipTest binary 0. Yes
Logger Log 0. Yes
Common PODArrayInsert 0. Yes
Common PODPushBackRawMany 0. Yes
Common PODNoOverallocation 0.003 Yes
Common PODInsertElementSizeNotMultipleOfLeftPadding 0.002 Yes
Common unescapeForFileName 0. Yes
ShellCommand Execute 0. Yes
ShellCommand ExecuteDirect 0.001 Yes
ShellCommand ExecuteWithInput 0.001 Yes
ShellCommand AutoWait 0.622 Yes
ThreadPool ConcurrentWait 0.069 Yes
ThreadPool GlobalFull1 0. Yes
ThreadPool GlobalFull2 0.012 Yes
ThreadPool ThreadRemoval 0.001 Yes
ThreadPool Loop 0.16 Yes
ThreadPool ExceptionFromSchedule 0.01 Yes
RaftLog serializeStr 0. Yes
RaftLog serializeRaw 0. Yes
RaftLog serializeEntry 0. Yes
RaftLog parseLogEntrybody 0. Yes
RaftLog appendEntry 0. Yes
RaftLog appendEntries 0. Yes
RaftLog loadLog 0. Yes
RaftLog splitSegment 0. Yes
RaftLog removeSegment 0. Yes
RaftLog truncateLog 0.001 Yes
RaftLog writeAt 0.002 Yes
RaftLog compact 0.001 Yes
RaftLog getEntry 0. Yes
RaftLog getEntries 0. Yes
RaftPerformance appendLogPerformance 0.131 Yes
RaftPerformance machineCreate 1.008 Yes
RaftSnapshot parseAndSerializeKeeperNode 0. Yes
RaftSnapshot createSnapshot_1 0. Yes
RaftSnapshot createSnapshot_2 0.004 Yes
RaftSnapshot readAndSaveSnapshot 0.005 Yes
RaftSnapshot parseSnapshot 6.232 Yes
RaftSnapshot createSnapshotWithFuzzyLog 5.266 Yes
RaftStateMachine serializeAndParse 0. Yes
RaftStateMachine appendEntry 1.001 Yes
RaftStateMachine modifyEntry 1. Yes
RaftStateMachine createSnapshot 2. Yes
RaftStateMachine syncSnapshot 2.003 Yes
RaftStateMachine initStateMachine 3.204 Yes
RaftStateManager load_srv_state 0. Yes

@raftkeeper-robot
Copy link

{report_title}

Classname Name Time Successful Error Message
RaftLog writeAndReadUInt32 0. No /home/runner/work/RaftKeeper/RaftKeeper/src/Service/tests/gtest_raft_log.cpp:36
Expected equality of these values:
x1
Which is: 25
y1 + 1
Which is: 26
Successful Test Cases
Classname Name Time Successful Error Message
OperatorsManipTest EscapingTest 0. Yes
OperatorsManipTest QuouteTest 0. Yes
OperatorsManipTest DoubleQuouteTest 0. Yes
OperatorsManipTest binary 0. Yes
Logger Log 0. Yes
Common PODArrayInsert 0. Yes
Common PODPushBackRawMany 0. Yes
Common PODNoOverallocation 0.004 Yes
Common PODInsertElementSizeNotMultipleOfLeftPadding 0.008 Yes
Common unescapeForFileName 0. Yes
ShellCommand Execute 0.001 Yes
ShellCommand ExecuteDirect 0.001 Yes
ShellCommand ExecuteWithInput 0.002 Yes
ShellCommand AutoWait 0.904 Yes
ThreadPool ConcurrentWait 0.064 Yes
ThreadPool GlobalFull1 0.011 Yes
ThreadPool GlobalFull2 0.012 Yes
ThreadPool ThreadRemoval 0.001 Yes
ThreadPool Loop 0.18 Yes
ThreadPool ExceptionFromSchedule 0.01 Yes
RaftLog serializeStr 0. Yes
RaftLog serializeRaw 0. Yes
RaftLog serializeEntry 0. Yes
RaftLog parseLogEntrybody 0. Yes
RaftLog appendEntry 0. Yes
RaftLog appendEntries 0. Yes
RaftLog loadLog 0. Yes
RaftLog splitSegment 0. Yes
RaftLog removeSegment 0. Yes
RaftLog truncateLog 0.001 Yes
RaftLog writeAt 0.001 Yes
RaftLog compact 0.001 Yes
RaftLog getEntry 0. Yes
RaftLog getEntries 0. Yes
RaftPerformance appendLogPerformance 0.333 Yes
RaftPerformance appendLogThread 0.852 Yes
RaftPerformance machineCreate 1.018 Yes
RaftSnapshot parseAndSerializeKeeperNode 0. Yes
RaftSnapshot createSnapshot_1 0.001 Yes
RaftSnapshot createSnapshot_2 0.021 Yes
RaftSnapshot readAndSaveSnapshot 0.018 Yes
RaftSnapshot parseSnapshot 6.927 Yes
RaftSnapshot createSnapshotWithFuzzyLog 5.27 Yes
RaftStateMachine serializeAndParse 0. Yes
RaftStateMachine appendEntry 1. Yes
RaftStateMachine modifyEntry 1. Yes
RaftStateMachine createSnapshot 2. Yes
RaftStateMachine syncSnapshot 1.003 Yes
RaftStateMachine initStateMachine 3.206 Yes
RaftStateManager load_srv_state 0. Yes

@raftkeeper-robot
Copy link

{report_title}

Classname Name Time Successful Error Message
test_auth.test test_digest_auth_basic[get_genuine_zk] 0.050 No AssertionError: assert b'data' != b'data'
test_auth.test test_digest_auth_basic[get_fake_zk] 0.009 No AssertionError: assert b'data' != b'data'
Successful Test Cases
Classname Name Time Successful Error Message
test_auth.test test_no_auth[get_genuine_zk] 0.053 Yes
test_auth.test test_no_auth[get_fake_zk] 0.115 Yes
test_auth.test test_super_auth 0.118 Yes
test_auth.test test_digest_auth_multiple[get_genuine_zk] 0.048 Yes
test_auth.test test_digest_auth_multiple[get_fake_zk] 0.315 Yes
test_auth.test test_partial_auth[get_genuine_zk] 0.035 Yes
test_auth.test test_partial_auth[get_fake_zk] 0.120 Yes
test_auth.test test_bad_auth 0.161 Yes
test_auth.test test_auth_snapshot 7.294 Yes
test_auth.test test_get_set_acl[get_genuine_zk] 0.032 Yes
test_auth.test test_get_set_acl[get_fake_zk] 0.218 Yes

@raftkeeper-robot
Copy link

{report_title}

Classname Name Time Successful Error Message
RaftLog writeAndReadUInt32 0. No /home/runner/work/RaftKeeper/RaftKeeper/src/Service/tests/gtest_raft_log.cpp:36
Expected equality of these values:
x1
Which is: 25
y1 + 1
Which is: 26
Successful Test Cases
Classname Name Time Successful Error Message
OperatorsManipTest EscapingTest 0. Yes
OperatorsManipTest QuouteTest 0. Yes
OperatorsManipTest DoubleQuouteTest 0. Yes
OperatorsManipTest binary 0. Yes
Logger Log 0. Yes
Common PODArrayInsert 0. Yes
Common PODPushBackRawMany 0. Yes
Common PODNoOverallocation 0.045 Yes
Common PODInsertElementSizeNotMultipleOfLeftPadding 0.028 Yes
Common unescapeForFileName 0. Yes
ShellCommand Execute 0.003 Yes
ShellCommand ExecuteDirect 0.003 Yes
ShellCommand ExecuteWithInput 0.003 Yes
ShellCommand AutoWait 3.247 Yes
ThreadPool ConcurrentWait 0.094 Yes
ThreadPool GlobalFull1 0.01 Yes
ThreadPool GlobalFull2 0.005 Yes
ThreadPool ThreadRemoval 0.002 Yes
ThreadPool Loop 0.302 Yes
ThreadPool ExceptionFromSchedule 0.01 Yes
RaftLog serializeStr 0. Yes
RaftLog serializeRaw 0. Yes
RaftLog serializeEntry 0. Yes
RaftLog parseLogEntrybody 0. Yes
RaftLog appendEntry 0. Yes
RaftLog appendEntries 0. Yes
RaftLog loadLog 0. Yes
RaftLog splitSegment 0.001 Yes
RaftLog removeSegment 0. Yes
RaftLog truncateLog 0.001 Yes
RaftLog writeAt 0.027 Yes
RaftLog compact 0.011 Yes
RaftLog getEntry 0. Yes
RaftLog getEntries 0. Yes
RaftPerformance appendLogPerformance 0.444 Yes
RaftPerformance appendLogThread 1.126 Yes
RaftPerformance machineCreate 1.021 Yes
RaftSnapshot parseAndSerializeKeeperNode 0. Yes
RaftSnapshot createSnapshot_1 0.004 Yes
RaftSnapshot createSnapshot_2 0.046 Yes
RaftSnapshot readAndSaveSnapshot 0.046 Yes
RaftSnapshot parseSnapshot 8.014 Yes
RaftSnapshot createSnapshotWithFuzzyLog 5.292 Yes
RaftStateMachine serializeAndParse 0. Yes
RaftStateMachine appendEntry 1. Yes
RaftStateMachine modifyEntry 1. Yes
RaftStateMachine createSnapshot 2. Yes
RaftStateMachine syncSnapshot 1.107 Yes
RaftStateMachine initStateMachine 3.212 Yes
RaftStateManager load_srv_state 0. Yes

@JackyWoo JackyWoo changed the title Make github CI more intuitive Add raftkeeper robot which will generate test report Sep 19, 2024
@JDRaftKeeper JDRaftKeeper deleted a comment from raftkeeper-robot bot Sep 19, 2024
@JDRaftKeeper JDRaftKeeper deleted a comment from raftkeeper-robot bot Sep 19, 2024
@JDRaftKeeper JDRaftKeeper deleted a comment from raftkeeper-robot bot Sep 19, 2024
@JDRaftKeeper JDRaftKeeper deleted a comment from raftkeeper-robot bot Sep 19, 2024
@JDRaftKeeper JDRaftKeeper deleted a comment from raftkeeper-robot bot Sep 19, 2024
@JDRaftKeeper JDRaftKeeper deleted a comment from raftkeeper-robot bot Sep 19, 2024
@raftkeeper-robot
Copy link

raftkeeper-robot bot commented Sep 19, 2024

Unit Test Report For Commit 38f4ca3

Classname Name Sanitize Type Status Error Message
RaftLog writeAndReadUInt32 /home/runner/work/RaftKeeper/RaftKeeper/src/Service/tests/gtest_raft_log.cpp:36
Expected equality of these values:
x1
Which is: 25
y1 + 1
Which is: 26
Successful Test Cases
Classname Name Sanitize Type Status Error Message
OperatorsManipTest EscapingTest
OperatorsManipTest QuouteTest
OperatorsManipTest DoubleQuouteTest
OperatorsManipTest binary
Logger Log
Common PODArrayInsert
Common PODPushBackRawMany
Common PODNoOverallocation
Common PODArrayInsertWithIllegalPadding
Common unescapeForFileName
ShellCommand Execute
ShellCommand ExecuteDirect
ShellCommand ExecuteWithInput
ShellCommand AutoWait
ThreadPool ConcurrentWait
ThreadPool GlobalFull1
ThreadPool GlobalFull2
ThreadPool ThreadRemoval
ThreadPool Loop
ThreadPool ExceptionFromSchedule
RaftLog serializeStr
RaftLog serializeRaw
RaftLog serializeEntry
RaftLog parseLogEntrybody
RaftLog appendEntry
RaftLog appendEntries
RaftLog loadLog
RaftLog splitSegment
RaftLog removeSegment
RaftLog truncateLog
RaftLog writeAt
RaftLog compact
RaftLog getEntry
RaftLog getEntries
RaftPerformance appendLogPerformance
RaftPerformance appendLogThread
RaftPerformance machineCreate
RaftSnapshot parseAndSerializeKeeperNode
RaftSnapshot createSnapshot_1
RaftSnapshot createSnapshot_2
RaftSnapshot readAndSaveSnapshot
RaftSnapshot parseSnapshot
RaftSnapshot createSnapshotWithFuzzyLog
RaftStateMachine serializeAndParse
RaftStateMachine appendEntry
RaftStateMachine modifyEntry
RaftStateMachine createSnapshot
RaftStateMachine syncSnapshot
RaftStateMachine initStateMachine
RaftStateManager load_srv_state

@JackyWoo JackyWoo force-pushed the make_ci_more_intuitive branch from 3cd3a7e to 19d97bc Compare September 19, 2024 12:23
@JackyWoo JackyWoo changed the title Add raftkeeper robot which will generate test report Add raftkeeper robot to generate test report Sep 19, 2024
@JackyWoo JackyWoo force-pushed the make_ci_more_intuitive branch 2 times, most recently from b9a081b to 8757e8a Compare September 19, 2024 12:58
@raftkeeper-robot
Copy link

Integration Test Report For Commit 38f4ca3

Classname Name Sanitize Type Status Error Message
test_auth test_digest_auth_basic[get_genuine_zk] AssertionError: assert b'data' != b'data'
test_auth test_digest_auth_basic[get_fake_zk] AssertionError: assert b'data' != b'data'
test_four_word_command test_cmd_mntr AssertionError: assert 92 == 0
+ where 92 = len('RaftKeeper v2.2.0-38f4ca3b9edae0fc05093f9736a788eaa2805e83, built on 2024-09-19 13:01:08 UTC')
Successful Test Cases
Classname Name Sanitize Type Status Error Message
test_auth test_no_auth[get_genuine_zk]
test_auth test_no_auth[get_fake_zk]
test_auth test_super_auth
test_auth test_digest_auth_multiple[get_genuine_zk]
test_auth test_digest_auth_multiple[get_fake_zk]
test_auth test_partial_auth[get_genuine_zk]
test_auth test_partial_auth[get_fake_zk]
test_auth test_bad_auth
test_auth test_auth_snapshot
test_auth test_get_set_acl[get_genuine_zk]
test_auth test_get_set_acl[get_fake_zk]
test_back_to_back test_simple_commands
test_back_to_back test_sequential_nodes
test_back_to_back test_stats
test_back_to_back test_watchers
test_back_to_back test_multi_transactions
test_back_to_back test_filtered_list
test_back_to_back test_multi_read
test_back_to_back test_random_requests
test_back_to_back test_end_of_session
test_back_to_back test_end_of_watches_session
test_back_to_back test_concurrent_watches
test_back_to_back test_system_nodes
test_back_to_back test_unregister_watch
test_converter test_smoke[True]
test_converter test_smoke[False]
test_converter test_simple_crud_requests[True]
test_converter test_simple_crud_requests[False]
test_converter test_multi_and_failed_requests[True]
test_converter test_multi_and_failed_requests[False]
test_forward_expiration test_forward_expiration
test_four_word_command test_cmd_ruok
test_four_word_command test_cmd_srst
test_four_word_command test_cmd_conf
test_four_word_command test_cmd_isro
test_four_word_command test_cmd_srvr
test_four_word_command test_cmd_stat
test_four_word_command test_cmd_cons
test_four_word_command test_cmd_crst
test_four_word_command test_cmd_dump
test_four_word_command test_cmd_wchs
test_four_word_command test_cmd_wchc
test_four_word_command test_cmd_wchp
test_four_word_command test_cmd_csnp
test_four_word_command test_cmd_lgif
test_four_word_command test_cmd_rqld
test_four_word_command test_white_list
test_learner test_read_write_multinode
test_learner test_watch_on_follower
test_learner test_session_expiration
test_learner test_follower_restart
test_learner test_simple_sleep_test
test_learner test_stop_learner
test_multinode_simple test_read_write_multi_node
test_multinode_simple test_watch_on_follower
test_multinode_simple test_session_expiration
test_multinode_simple test_follower_restart
test_multinode_simple test_simple_sleep_test
test_nodes_add test_nodes_add
test_nodes_remove test_nodes_remove
test_nodes_replace test_node_replace
test_non_snapshot_restart test_restart
test_persistent_log test_state_after_restart
test_persistent_log test_state_duplicate_restart
test_persistent_log test_ephemeral_after_restart
test_persistent_log_multinode test_restart_multi_node
test_restore_from_snapshot test_recover_from_snapshot
test_session test_reconnection
test_session_fake_client test_session_timeout
test_session_fake_client test_session_max_min_session_timeout
test_session_fake_client test_invalid_timeout_setting
test_snapshot_restart test_restart[False]
test_snapshot_restart test_restart[True]
test_snapshot_small_distance test_snapshot_and_load[False]
test_snapshot_small_distance test_snapshot_and_load[True]
test_snapshots test_state_after_restart[node0]
test_snapshots test_state_after_restart[node1]
test_snapshots test_ephemeral_after_restart[node0]
test_snapshots test_ephemeral_after_restart[node1]
test_snapshots test_restart_with_no_log[node0]
test_snapshots test_restart_with_no_log[node1]
test_snapshots test_snapshot_clear[node0]
test_snapshots test_snapshot_clear[node1]
test_snapshots_multinode test_restart_multinode[False]
test_snapshots_multinode test_restart_multinode[True]
test_stale_node_recovery test_stale_node_recovery
test_three_nodes_two_alive test_start_offline
test_three_nodes_two_alive test_start_non_existing
test_three_nodes_two_alive test_restart_third_node
test_two_nodes_cluster test_read_write_two_nodes
test_two_nodes_cluster test_read_write_two_nodes_with_blocked
test_znode_time test_between_servers
test_znode_time test_server_restart

@JackyWoo JackyWoo force-pushed the make_ci_more_intuitive branch 2 times, most recently from 0bdd6ae to 33c6e89 Compare September 19, 2024 13:44
@JackyWoo JackyWoo requested a review from lzydmxy September 19, 2024 13:47
@raftkeeper-robot
Copy link

raftkeeper-robot bot commented Sep 19, 2024

Unit test report for commit 22810e6.

All test cases passed!

Successful Test Cases
Classname Name Sanitize Type Status Error Message
OperatorsManipTest EscapingTest
OperatorsManipTest QuouteTest
OperatorsManipTest DoubleQuouteTest
OperatorsManipTest binary
Logger Log
Common PODArrayInsert
Common PODPushBackRawMany
Common PODNoOverallocation
Common PODArrayInsertWithIllegalPadding
Common unescapeForFileName
ShellCommand Execute
ShellCommand ExecuteDirect
ShellCommand ExecuteWithInput
ShellCommand AutoWait
ThreadPool ConcurrentWait
ThreadPool GlobalFull1
ThreadPool GlobalFull2
ThreadPool ThreadRemoval
ThreadPool Loop
ThreadPool ExceptionFromSchedule
RaftLog writeAndReadUInt32
RaftLog serializeStr
RaftLog serializeRaw
RaftLog serializeEntry
RaftLog parseLogEntrybody
RaftLog appendEntry
RaftLog appendEntries
RaftLog loadLog
RaftLog splitSegment
RaftLog removeSegment
RaftLog truncateLog
RaftLog writeAt
RaftLog compact
RaftLog getEntry
RaftLog getEntries
RaftPerformance appendLogPerformance
RaftPerformance appendLogThread
RaftPerformance machineCreate
RaftSnapshot parseAndSerializeKeeperNode
RaftSnapshot createSnapshot_1
RaftSnapshot createSnapshot_2
RaftSnapshot readAndSaveSnapshot
RaftSnapshot parseSnapshot
RaftSnapshot createSnapshotWithFuzzyLog
RaftStateMachine serializeAndParse
RaftStateMachine appendEntry
RaftStateMachine modifyEntry
RaftStateMachine createSnapshot
RaftStateMachine syncSnapshot
RaftStateMachine initStateMachine
RaftStateManager load_srv_state

@JackyWoo JackyWoo force-pushed the make_ci_more_intuitive branch from 33c6e89 to d16ab80 Compare September 19, 2024 14:03
@raftkeeper-robot
Copy link

Integration test report for commit 22810e6.

All test cases passed!

Successful Test Cases
Classname Name Sanitize Type Status Error Message
test_auth test_digest_auth_basic[get_genuine_zk]
test_auth test_digest_auth_basic[get_fake_zk]
test_auth test_no_auth[get_genuine_zk]
test_auth test_no_auth[get_fake_zk]
test_auth test_super_auth
test_auth test_digest_auth_multiple[get_genuine_zk]
test_auth test_digest_auth_multiple[get_fake_zk]
test_auth test_partial_auth[get_genuine_zk]
test_auth test_partial_auth[get_fake_zk]
test_auth test_bad_auth
test_auth test_auth_snapshot
test_auth test_get_set_acl[get_genuine_zk]
test_auth test_get_set_acl[get_fake_zk]
test_back_to_back test_simple_commands
test_back_to_back test_sequential_nodes
test_back_to_back test_stats
test_back_to_back test_watchers
test_back_to_back test_multi_transactions
test_back_to_back test_filtered_list
test_back_to_back test_multi_read
test_back_to_back test_random_requests
test_back_to_back test_end_of_session
test_back_to_back test_end_of_watches_session
test_back_to_back test_concurrent_watches
test_back_to_back test_system_nodes
test_back_to_back test_unregister_watch
test_converter test_smoke[True]
test_converter test_smoke[False]
test_converter test_simple_crud_requests[True]
test_converter test_simple_crud_requests[False]
test_converter test_multi_and_failed_requests[True]
test_converter test_multi_and_failed_requests[False]
test_forward_expiration test_forward_expiration
test_four_word_command test_cmd_ruok
test_four_word_command test_cmd_mntr
test_four_word_command test_cmd_srst
test_four_word_command test_cmd_conf
test_four_word_command test_cmd_isro
test_four_word_command test_cmd_srvr
test_four_word_command test_cmd_stat
test_four_word_command test_cmd_cons
test_four_word_command test_cmd_crst
test_four_word_command test_cmd_dump
test_four_word_command test_cmd_wchs
test_four_word_command test_cmd_wchc
test_four_word_command test_cmd_wchp
test_four_word_command test_cmd_csnp
test_four_word_command test_cmd_lgif
test_four_word_command test_cmd_rqld
test_four_word_command test_white_list
test_learner test_read_write_multinode
test_learner test_watch_on_follower
test_learner test_session_expiration
test_learner test_follower_restart
test_learner test_simple_sleep_test
test_learner test_stop_learner
test_multinode_simple test_read_write_multi_node
test_multinode_simple test_watch_on_follower
test_multinode_simple test_session_expiration
test_multinode_simple test_follower_restart
test_multinode_simple test_simple_sleep_test
test_nodes_add test_nodes_add
test_nodes_remove test_nodes_remove
test_nodes_replace test_node_replace
test_non_snapshot_restart test_restart
test_persistent_log test_state_after_restart
test_persistent_log test_state_duplicate_restart
test_persistent_log test_ephemeral_after_restart
test_persistent_log_multinode test_restart_multi_node
test_restore_from_snapshot test_recover_from_snapshot
test_session test_reconnection
test_session_fake_client test_session_timeout
test_session_fake_client test_session_max_min_session_timeout
test_session_fake_client test_invalid_timeout_setting
test_snapshot_restart test_restart[False]
test_snapshot_restart test_restart[True]
test_snapshot_small_distance test_snapshot_and_load[False]
test_snapshot_small_distance test_snapshot_and_load[True]
test_snapshots test_state_after_restart[node0]
test_snapshots test_state_after_restart[node1]
test_snapshots test_ephemeral_after_restart[node0]
test_snapshots test_ephemeral_after_restart[node1]
test_snapshots test_restart_with_no_log[node0]
test_snapshots test_restart_with_no_log[node1]
test_snapshots test_snapshot_clear[node0]
test_snapshots test_snapshot_clear[node1]
test_snapshots_multinode test_restart_multinode[False]
test_snapshots_multinode test_restart_multinode[True]
test_stale_node_recovery test_stale_node_recovery
test_three_nodes_two_alive test_start_offline
test_three_nodes_two_alive test_start_non_existing
test_three_nodes_two_alive test_restart_third_node
test_two_nodes_cluster test_read_write_two_nodes
test_two_nodes_cluster test_read_write_two_nodes_with_blocked
test_znode_time test_between_servers
test_znode_time test_server_restart

@JackyWoo
Copy link
Contributor Author

All tests passed. Please see the comments history by raftkeeper-robot.

Copy link
Contributor

@lzydmxy lzydmxy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@JackyWoo JackyWoo merged commit d475228 into JDRaftKeeper:master Sep 20, 2024
19 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
code refactor Code refactor
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add raftkeeper robot to generate test report
2 participants