1.1.0-rc0

Highlights

• Upgrade Apache Kafka from version 3.4.0 to 3.7.0

What's Changed

• chore: move s3stream module back to automq kafka repo by @daniel-y in #929
• feat(others): migrate other files by @superhx in #930
• fix(README): add README image by @superhx in #931
• feat(s3stream): add s3stream into gradle build system by @ShadowySpirits in #932
• fix(core): fix optimize condition check by @SCNieh in #934
• fix(core): fix configuration for test cluster by @ShadowySpirits in #936
• feat(s3stream): policies of allocating memory by @Chillax-0v0 in #938
• fix(core): fix ElasticReplicaManagerTest by @ShadowySpirits in #940
• chore(s3stream): remove allocator policy "UNPOOLED_HEAP" by @Chillax-0v0 in #942
• chore: optimize README file by @KaimingWan in #945
• feat(metadata): add automq metadata to metadata shell by @superhx in #947
• chore(workflow): ignore tags like "1.0.2-s3stream" by @Chillax-0v0 in #955
• perf(ReplicaManager): release unused permits after reads by @Chillax-0v0 in #935
• feat: tagging S3 objects by @Chillax-0v0 in #956
• feat(config): auto memory adaptation by @Chillax-0v0 in #949
• fix(s3stream): set tagging only when not null by @Chillax-0v0 in #957
• fix(controller): fix partition migration fail after broker fence by @superhx in #958
• fix(core): fix adjusting s3 cache related configuration by @ShadowySpirits in #959
• fix(controller): fix reassignment fail by @superhx in #960
• fix(core): fix ElasticLog#formatStreamKey by @ShadowySpirits in #961
• fix(core): fix repeatedly opening the partition by @ShadowySpirits in #962
• fix(core): implement parallelism in the creating log process by @ShadowySpirits in #963
• feat: add hook point by @superhx in #964
• refactor(config): adjust configs in KafkaConfig rather than Kafka by @Chillax-0v0 in #970
• fix(bin): fix logs variable by @SCNieh in #972
• feat(metrics): support kraft related metrics by @SCNieh in #974
• fix(tools): controllerOnlyMode is false no extra commands will be output by @funky-eyes in #967
• feat(tool): next node id by @superhx in #976
• fix(test): fix new group coordinator load by @superhx in #977
• fix(test): disable E2E zookeeper related test by @superhx in #980
• fix(test): update E2E base image by @superhx in #981
• fix(common): get cause NPE by @superhx in #984
• fix(network): adapt the callback queue by @superhx in #985
• chore(E2E): split main E2E test to 3 tasks by @superhx in #986
• fix(issues987): fix StreamMetadataManager NPE by @superhx in #988
• fix(metadata): avoid getObjects return invalid when endOffset is -1 by @SCNieh in #991
• fix(s3stream): fix potential concurrent modification on size during tryRealFree by @SCNieh in #990
• fix(s3stream/wal): fail fast if the path does not exist in recovery mode by @Chillax-0v0 in #993
• fix(test): increase heap size to 1GiB by @superhx in #994
• fix(issues996): fix fetch NPE by @superhx in #997
• chore(test): move transactions_test to seperate test suite by @superhx in #998
• fix(s3stream): fix cf combination by @SCNieh in #1000
• refactor(s3stream): rename tagging key from "clusterId" to "automq:ClusterID" by @Chillax-0v0 in #999
• refactor(s3stream): rename tagging key from "automq:ClusterID" to "s3stream:namespace" by @Chillax-0v0 in #1001
• test(s3stream/wal): check file existence on startup rather than init by @Chillax-0v0 in #1004
• chore(workflow): run s3stream tests by @Chillax-0v0 in #1003
• feat(core): optimize block cache performance for high-spec node by @SCNieh in #1005
• fix(s3stream): fix pending fetches modification order by @SCNieh in #1008
• fix(s3stream): temporarily disable throttle for slow read by @SCNieh in #1009
• perf(s3stream): reuse ObjectMapper by @lifepuzzlefun in #1012
• chore(core): upgrade "netty-tcnative-boringssl-static" from 2.0.48 to… by @Chillax-0v0 in #1010
• revert(s3stream): revert bypass slow read throttle by @SCNieh in #1015
• fix: order the transaction requests in request pipeline to adapt KIP-890 by @superhx in #1016
• feat(auto_balancer): use nw bandwidth capacity as score limit by @SCNieh in #1018
• feat(s3stream): provide extra tokens to prevent throttle starvation by @SCNieh in #1020
• fix(test): disable useless E2E test case by @superhx in #1019
• feat(auto_balancer): log expected dist bound on each detection by @SCNieh in #1022
• chore(all): checkstyle by @superhx in #1026
• chore(all): double check the merge by @superhx in #1029
• feat: merge apache kafka trunk by @superhx in #1030
• fix(test): E2E add consumer rebalance protocols by @superhx in #1032
• perf(s3stream): only read the first record from log cache before reading block cache by @Chillax-0v0 in #1011
• fix(s3stream): use thread safe data structures to prevent race condition by @SCNieh in #1036
• fix(core): enhancement AnomalyDetector and LoadRetriever by @Wzy19930507 in #1035
• revert(s3stream): "perf(s3stream): only read the first record from log cache before reading block cache" by @Chillax-0v0 in #1038
• chore(action): trigger build for any changes by @superhx in #1040
• feat(s3stream): add S3 API compatibility for BOS DeleteObjects by @lifepuzzlefun in #1028
• fix(metrics): fix jmx rules by @SCNieh in #1041
• fix(stream): fix compaction interval check by @superhx in #1046
• fix(dashboard): present latency avg to timed range by @SCNieh in #1045
• fix(jmx_rule): remove unused rules that could lead to confusion by @SCNieh in #1048
• chore(s3stream/wal): upgrade metrics level of wal_write and wal_await by @Chillax-0v0 in #1047
• fix(s3stream): limit the expired objects delete count by @superhx in #1050
• fix(config): add elasticstream.replication.factor for compability by @superhx in #1051
• fix(issues1060): only allow one cleanup task infight by @superhx in #1062
• fix(controller): check continuity after redundancy in commitStreamSetObject by @Chillax-0v0 in #1056
• fix(test): disable new consumer coordinator unstable consumer protoco… by @superhx in #1066
• test(controller): commit the same stream set object or stream object by @Chillax-0v0 in #1064
• fix(core): ensure partition closed before metadata listener close by @superhx in #1068
• fix(issues1069): stream client shutdown await opening stream close by @superhx in #1071
• fix(test): ignore unstable new consumer coordinator e2e test by @superhx in #1073
• chore(workflow): ignore tags like "1.0.3-s3stream" by @Chillax-0v0 in #1043
• feat(release): bump version to 1.1.0-rc0 by @superhx in #1077

New Contributors

• @lifepuzzlefun made their first contribution in #1012
• @Wzy19930507 made their first contribution in #1035

Full Changelog: 1.0.4...1.1.0-rc0