3.0.2.0

New Features:

• Replica 3 can be specified when creating a database
• RAFT protocol is enabled automatically in case of replica 3
• Replica 1 and 3 can be switched by "alter database" command

Enhancements:

• Performance optimization for inserting data in SQL mode
• Performance optimization for replica 3
• Performance optimization for querying data in a lot of scenarios
• Stability improvement for replica 3
• Execute "alter database replica" in async way

Fixed Bugs:

• Some coredump problems
• Some OOM issues
• A series of functional bugs

What's Changed

• Revert "Revert "enh: row optimize2"" by @guanshengliang in #18418
• test：add test case for TS-1939 by @jiacy-jcy in #18394
• fix:initialize maxts by @54liuyao in #18400
• refactor: enable continue query when the buffer of sink node is empty by @hjxilinx in #18395
• fix(shell): add help command and fix create table filed complete by @DuanKuanJun in #18422
• test: adjust asan case by @guanshengliang in #18423
• test: add asan case by @guanshengliang in #18425
• refactor(sync): add timestamp trace log when elect and heartbeat by @castermode in #18424
• fix(query): fix error in seq fetch data block. by @hjxilinx in #18426
• test: add asan case and adjust python test frame by @guanshengliang in #18427
• fix: memory leak while schedule stream by @guanshengliang in #18421
• docs: add StackOverflow link by @arielyang in #18428
• fix(stream): heap uaf by @cosmic-jc in #18429
• enh: last cache optimize by @xiao-yu-wang in #18384
• fix:Explicit null dereferenced by @54liuyao in #18419
• fix(sync): if msg commit, put it into apply-queue, do not care return code by @castermode in #18431
• fix: auto creating table failed issue when table already exists by @dapan1121 in #18435
• test: add asan case by @guanshengliang in #18432
• fix(tdb): zero pOlds[i]'s nOverflow and assert it's zero when committing by @stephenkgu in #18434
• fix(meta): return invalid message if cannot getting value from uididx by @stephenkgu in #18437
• fix: fix invalid packet by @yihaoDeng in #18439
• enh: set max restart time of taosd to 3; allow disable alert in pod by @tangfangzhi in #18397
• fix(shell) add one blank after affected word by @DuanKuanJun in #18444
• fix: [ASAN] fix nullpointer issue in tdatablock.c by @glzhao89 in #18441
• fix(tdb/pcache): type nPages as nPage by @stephenkgu in #18442
• test/update vnode by @wenzhouwww in #18440
• fix(query): check for null ptr before extracting info by @hjxilinx in #18450
• fix： query failed issue caused of db dropped by @dapan1121 in #18398
• fix(tmq): time wait by @cosmic-jc in #18454
• fix: duplicated explain response issue by @dapan1121 in #18455
• fix:support scalar function with fill by @54liuyao in #18456
• fix: asan problems for rsma by @kailixu in #18458
• docs: release 3.0.1.8 by @xleili in #18466
• fix: memory leak while subscribe by @guanshengliang in #18462
• refactor(sync): add trace log by @castermode in #18463
• fix: fix mem leak by @yihaoDeng in #18438
• test: add asan case by @guanshengliang in #18453
• doc: upgrade grafana plugin version by @sunpe in #18460
• fix(query): check the error code, if the downstream is an exchange operator. by @hjxilinx in #18464
• enh(stream): new api for stream queue by @cosmic-jc in #18459
• test: add asan case by @guanshengliang in #18469
• refactor: adjust syncLogHeartbeat by @guanshengliang in #18467
• Release/ver 3.0.1.8 by @xleili in #18474
• test:add test case into ci by @jiacy-jcy in #18448
• build: release ver-3.0.1.8 by @guanshengliang in #18475
• enh: add debug info by @yihaoDeng in #18452
• refactor(sync): optimized heartbeat timer by @castermode in #18472
• test: add asan case by @guanshengliang in #18473
• chore: taos-tools use localfile asdeps by @sangshuduo in #18471
• coverity problem fixed by @DuanKuanJun in #18461
• fix: memory leak and defects in covrity by @wangmm0220 in #18465
• Revert "enh: add debug info" by @guanshengliang in #18479
• fix: memory leak by @cosmic-jc in #18476
• test: add asan case by @guanshengliang in #18478
• test: add asan case by @guanshengliang in #18482
• fix: disable taos-tools cunit test on windows by @sangshuduo in #18484
• test: adjust case for asan mode by @guanshengliang in #18487
• test: add asan case and fix tmqSim error by @guanshengliang in #18489
• Update number of stars in README by @saivishwak in #18488
• docs: Update number of stars in README by @guanshengliang in #18490
• test: add tmq case by @guanshengliang in #18491
• fix: memory leak while subscribe by @guanshengliang in #18495
• test: add asan case by @guanshengliang in #18493
• feat: taosbenchmark supports retry by @sangshuduo in #18496
• refactor: improve the perf in query by @hjxilinx in #18468
• docs: update examples/jdbc demo readme by @sangshuduo in #18499
• fix: memory leak while subscribe by @guanshengliang in #18497
• refactor: do some internal refactor. by @hjxilinx in #18500
• test:add win testcase in ci by @tomchon in #18492
• fix: memory leak by @cosmic-jc in #18504
• test: adjust cluster case for asan mode by @guanshengliang in #18507
• test: add asan case by @guanshengliang in #18510
• fix(tdb/flush): make drop two-child rbtree node works by @stephenkgu in #18513
• refactor: do some internal refactor. by @hjxilinx in #18509
• fix: select null error by @xiao-yu-wang in #18508
• fix(stream): fill combine with subtable by @cosmic-jc in #18515
• fix:installer,The installation cannot be completed on the mac by @facetosea in #18512
• fix(sync): fix asan error, TD-20801 by @castermode in #18520
• fix: deadlock while alter db replica by @guanshengliang in #18523
• refactor: do some internal refactor. by @hjxilinx in #18516
• fix: [ASAN] stack buffer overflow by @glzhao89 in #18519
• fix:during installation,dll file cannot overwrite. by @facetosea in #18526
• enh: support multiple query groups in exchange operator by @dapan1121 in #18524
• feat: taosdump for windows by @sangshuduo in #18529
• enh: adjust para by @yihaoDeng in #18502
• test:add testcase of win ci by @tomchon in #18517
• fix(query): memory leak with pPageIdList on sort by @DuanKuanJun in #18527
• fix: alter db pages memory leak by @hzcheng in #18528
• 修改可能导致读取额外内容的BUG by @maikebing in #18518
• test: add asan case by @guanshengliang in #18538
• fix: cpuid.h error in mac for M1 cpu type by @wangmm0220 in #18536
• test: add test cases by @xiaopingcs in #18530
• merge from main to 3.0 branch by @guanshengliang in #18540
• fix: planner error by @xiao-yu-wang in #18542
• refactor(sync): add trace log for elect count, become leader count, c… by @castermode in #18544
• enh: add dropping status for vgroups by @guanshengliang in #18548
• chore: re-enable old style sanitizer config for taos-tools by @sangshuduo in #18539
• fix:calculate the correct deletion range by @54liuyao in #18543
• fix: get cpuid on x86 only by @sangshuduo in #18552
• fix:add interface with ttl for schemaless by @wangmm0220 in #18537
• fix: stream plan error by @xiao-yu-wang in #18549
• refactor(sync): add interface syncSnapshotSending, syncSnapshotRecving by @castermode in #18551
• enh: refactor retry by @yihaoDeng in #18533
• chore: taos-tools add sanitizer workflow by @sangshuduo in #18555
• fix(stream): delete multiple row by @cosmic-jc in #18554
• fix:end ts of data block by @54liuyao in #18558
• fix(query): handle countAlwaysReturnValue behavior by @glzhao89 in #18501
• fix:[TD-20612] error if write raw with some cols by @wangmm0220 in #18553
• refactor(sync): modify info log by @castermode in #18563
• test: modify limit2.sim to limit.py by @plum-lihui in #18565
• fix(query): add an null ptr checking before copying memory. by @hjxilinx in #18566
• docs: Update number of stars in 02-intro.md by @fenghuazzm in #18567
• fix:concurrency conflicts occur when obtaining windows system time by @facetosea in #18556
• refacotr(sync), force stop snapshot sender/receiver when stop node by @castermode in #18568
• enh: show more info while drop dnode by @guanshengliang in #18561
• enh: add trace info by @yihaoDeng in #18535
• fix: taosbenchmark printf format by @sangshuduo in #18569
• fix:stream scan handles empty datablcok by @54liuyao in #18570
• fix(query): fix avg calculation error after SIMD optimize by @glzhao89 in #18574
• enh: show more info while drop dnode by @guanshengliang in #18577
• fix: benchmark query result precision by @sangshuduo in #18581
• refactor: do some internal refactor. by @hjxilinx in #18579
• refactor(sync): if already start, force close snapshot receiver by @castermode in #18587
• refactor: do some internal refactor. by @hjxilinx in #18591
• fix: fix index filter crash by @yihaoDeng in #18588
• opti:get meta cost for schemaless & add config for write batch in schemaless by @wangmm0220 in #18571
• fix(query): fix interp with fill(prev) error by @glzhao89 in #18580
• fix: build taosdump release by default for windows by @sangshuduo in #18594
• test:modify base version from 3.0.1.0 to 3.0.1.8 in compatibility testcase by @tomchon in #18586
• test: remove unstable case by @guanshengliang in #18601
• feat: sql command 'show user privileges' by @xiao-yu-wang in #18584
• refactor(sync): help to display leader** by @castermode in #18589
• refactor(sync): add traceId log by @castermode in #18604
• refactor(sync): delete code wait snapshot end in pre-close by @castermode in #18605
• enh: show leader ** if vnode can read and can't write by @guanshengliang in #18593
• Update 01-faq.md by @boxiaobj in #18608
• fix: show Permission denied error in mac by @guanshengliang in #18610
• fix:stream crash && add debug log by @54liuyao in #18607
• feat: implement pipelining of sync by @bgzhao66 in #18449
• refactor(sync): put heartbeat-reply msg into sync-ctrl-queue by @castermode in #18614
• opti: get meta in schemaless by @wangmm0220 in #18615
• fix(sync): delete duplicate code by @castermode in #18619
• enh: add topic privilege in mnode by @guanshengliang in #18603
• fix: taosbenchmark set config by @sangshuduo in #18616
• fix: get prevLogTerm of index zero as 0 only when firstVer is zero by @bgzhao66 in #18622
• refactor(stream): distributed checkpoint by @cosmic-jc in #18596
• fix:window time wait by @facetosea in #18613
• enh: refactor retry code by @yihaoDeng in #18611
• fix: compatility after update stream by @guanshengliang in #18625
• refact: adust error code while dnode startup by @guanshengliang in #18629
• fix: check subquery time series error by @xiao-yu-wang in #18630
• doc: update grafana version in English doc and modifythe way grafana plugin installed in application doc by @sunpe in #18635
• doc: writting from kafka by @sunpe in #18626
• enh: support query retry cause of dnode stopped by @dapan1121 in #18599
• feat: sql command 'show user privileges' by @xiao-yu-wang in #18636
• enh: ins_table count optimize by @xiao-yu-wang in #18618
• fix: filter memory leak cause of same const strings by @dapan1121 in #18632
• refact: remove TSDB_CODE_APP_NOT_READY and TSDB_CODE_NODE_NOT_DEPLOYED by @guanshengliang in #18642
• test: add asan case by @guanshengliang in #18645
• enh: remove sync batch propose in vnode by @guanshengliang in #18647
• fix(tsdb/cache): use lru erase to invalidate cache entries by @stephenkgu in #18640
• enh(query): optimize query perf. by @hjxilinx in #18592
• enhancement: table count scan by @shenglian-zhou in #18590
• fix: remove invalid table by @yihaoDeng in #18621
• enh: remove TSDB_CODE_RPC_REDIRECT by @guanshengliang in #18651
• enh: change rpc log level by @yihaoDeng in #18653
• refactor: add function for extract the required buffer during query. by @hjxilinx in #18652
• enh(taosAdapter): support loongArch64 by @huskar-t in #18654
• fix: get result of tmsPutToQueue for FpCommitCb by @bgzhao66 in #18656
• refact: remove some error codes by @guanshengliang in #18659
• enh(query): improve the performance and add some todo by @hjxilinx in #18661
• fix: synchronize syncPropose for executing blocking msgs in vnodeProposeMsg by @bgzhao66 in #18668
• fix: truncate WAL on need while syncLogBufferRollback by @bgzhao66 in #18671
• refactor(sync): add config item and default value in sync by @castermode in #18672
• enh(query): avoid repeatly load del file. by @hjxilinx in #18670
• feat: taosbenchmark supports vgid by @sangshuduo in #18657
• feat(api): add new api int64_t taos_affected_rows64 by @DuanKuanJun in #18646
• enh: optimize multiple table insert by @dapan1121 in #18643
• fix: dataDir process of multi-tier storage conform to 2.6 by @kailixu in #18675
• feat: async commit by @hzcheng in #18674
• release: build 3.0.2.0 by @guanshengliang in #18680
• fix: tsdb do retention fix by @kailixu in #18679
• docs: update connector matrix with nodejs ws sql support by @sangshuduo in #18687
• docs: update connector matrix for go ws stmt by @sangshuduo in #18688
• docs: update connector matrix for go ws tmq by @sangshuduo in #18690
• docs: update connector matrix for go ws bulkpulling by @sangshuduo in #18691
• fix(sync): fix snapshot receiver waiting time by @castermode in #18685
• fix: fix compiler warning in taosudf.h by @shenglian-zhou in #18686
• test:comment commit of tmq consumer in crashGen by @tomchon in #18700
• fix: commit tdb in write thread by @stephenkgu in #18692
• fix: disable crashgen tmq callback temporarily by @sangshuduo in #18702
• fix: add 'JNI_RESULT_SET_NULL' error code by @huolibo in #18697
• fix: use tdbTrace to reduce 135 debug log output by @stephenkgu in #18684
• enh(query): add timetruncate function ignore timezone option for 1d by @glzhao89 in #18694
• refactor(sync): modify/use default config value by @castermode in #18695
• fix(shell): forbid .taos_history record password for security by @DuanKuanJun in #18698
• fix(log): ignore create log error by @DuanKuanJun in #18715
• fix:stddev\fisrt\last combine function by @54liuyao in #18705
• fix: csharp test case by @sangshuduo in #18706
• fix: walSaveMeta ahead of deleting WAL files as gc in walEndSnapshot by @bgzhao66 in #18701
• fix(sync): close snapshot receiver in pre-close by @castermode in #18716
• refact: remove redundant error codes by @guanshengliang in #18681
• fix: add redirect error code and fix no error msg issue by @dapan1121 in #18717
• feat: update taosadapter branch by @sunpe in #18729
• fix: synchronize access of pWalHandle with mutex in raftLogGetEntry by @bgzhao66 in #18732
• fix: dataDir process for multi-tier storage by @kailixu in #18733
• enh: allow any user to create a topic by @guanshengliang in #18731
• test: add cases for create and drop topic by @guanshengliang in #18735
• feat: add stream option 'delete_mark' by @xiao-yu-wang in #18740
• enh: enable timeout checking of sync Resp with ttl as 30s by @bgzhao66 in #18745
• fix(query): check null ptr before dereferencing it. by @hjxilinx in #18708
• refactor(sync): add reserved field in message by @castermode in #18746
• fix: fix count VAR type column error cause of reading incorrect sma results by @glzhao89 in #18742
• enh: add fail-fast by @yihaoDeng in #18725
• fix:read data and compute group id by @54liuyao in #18741
• fix: fix tbnameIn bug on normal table by @yihaoDeng in #18747
• enh: speed up drop dnode and avoid snapshot transfer by @guanshengliang in #18738
• fix: add stmt sort merge case by @dapan1121 in #18749
• fix; add msg type by @yihaoDeng in #18751
• enh: support more fail-fast msgtype by @yihaoDeng in #18752
• fix: fix task redirect not finished issue by @dapan1121 in #18743
• fix: modify qnode query thread min number by @dapan1121 in #18757
• fix: query message compatibility by @xiao-yu-wang in #18764
• fix: taosdump atomic static link by @sangshuduo in #18763
• fix: client retry insert based on some error code by @dapan1121 in #18768
• fix: retention by @hzcheng in #18766
• enh: check contiguousness of indexes applied to vnode by @bgzhao66 in #18769
• fix: fix mem leak by @yihaoDeng in #18777
• fix(query):fix the invalid write operation. by @hjxilinx in #18778
• fix: taosbenchmark vgid ntb by @sangshuduo in #18780
• refactor(sync): re send snapshot in timer-routine when response timeout by @castermode in #18783
• refact: adjust some assert cases by @guanshengliang in #18775
• enh: add tassert funcs (TD-20045) by @guanshengliang in #18772
• Revert "refact: adjust some assert cases" by @guanshengliang in #18786
• fix: make invalid_commandline.py and demo.py back to test by @sangshuduo in #18784
• enh: add tassert by @guanshengliang in #18788
• fix: query message compatibility by @xiao-yu-wang in #18774
• fix: add default command line to start udfd when taosd is started directly from command line by @shenglian-zhou in #18727
• enh: alter db replica return quickly, operation executed asynchronously by @guanshengliang in #18787
• fix(query): ensure the SMA SArray* capacity is enough big to save all the columns for scanning by @DuanKuanJun in #18779
• enh: merge getmetafromcache and getvgroupfromcache interface by @xiao-yu-wang in #18800
• fix: mem leak by @cosmic-jc in #18794
• enh: collect and record the signal which the dnode was killed in the log file by @guanshengliang in #18793
• fix: dismiss coverity issues by @stephenkgu in #18799
• fix:stream update data by @54liuyao in #18803
• fix(query): fix percentile crash when input has more than 10 million records by @glzhao89 in #18758
• fix: update diskId when migrate DFileSet by @kailixu in #18791
• fix: keep option of database with ns precision by @kailixu in #18790
• enh: print dnode startup parameters by @guanshengliang in #18798
• enh: merge getmetafromcache and getvgroupfromcache interface by @xiao-yu-wang in #18809
• enh: merge getmetafromcache and getvgroupfromcache interface by @xiao-yu-wang in #18814
• fix:taos.dll export taosDatatype by @facetosea in #18806
• fix: update epset by @yihaoDeng in #18810
• fix(sync): checkout NULL pointer by @castermode in #18808
• fix:read the deleted data by @54liuyao in #18762
• fix: compile warn by @xiao-yu-wang in #18819
• fix: taos shell prompt for websocket by @sangshuduo in #18826
• enh: check topic privilege by @cosmic-jc in #18817
• fix(build):centos7 x64 makeinstall cannt write taod service to systemctl by @xleili in #18827
• fix: taosbenchmark use fully rest interface by @sangshuduo in #18828
• Fix/xsren/td 20141 mac os os type empty by @facetosea in #18807
• fix: dismiss coverity issues by @stephenkgu in #18805
• Fix: vnode snapshot problem by @hzcheng in #18830
• enh: TD-20975 by @yihaoDeng in #18829
• release: build 3.0.2.0 by @guanshengliang in #18832
• enh: tolerate exec error by @cosmic-jc in #18835
• enh: insert multi tables optimize by @xiao-yu-wang in #18815
• build: upgrade taosadapter version by @sunpe in #18834
• test: temporarily disable go.sh test by @sangshuduo in #18845
• Revert "fix(build):centos7 x64 makeinstall cannt write taod service to systemctl" by @sangshuduo in #18836
• fix: release lock and memory in exceptional cases by @stephenkgu in #18837
• fix: check topic privilege only by @guanshengliang in #18841
• fix: supportVnodes config is not in effect by @guanshengliang in #18838
• release: build 3.0.2.0 by @guanshengliang in #18846
• fix: use taos-connector-rust in packaging scripts by @zitsen in #18663
• release: build 3.0.2.0 by @guanshengliang in #18847
• feat:add delete mark for sma by @54liuyao in #18842
• fix: exhandle mem leak by @yihaoDeng in #18848
• fix: fix udfd crash by @yihaoDeng in #18850
• release: build 3.0.2.0 by @guanshengliang in #18861
• fix: change default sch value by @yihaoDeng in #18857
• fix: mem leak by @cosmic-jc in #18854
• fix: donot print log while assert by @guanshengliang in #18867
• fix: shell crash TD-21115 by @yihaoDeng in #18869
• fix:fix mem leak by @yihaoDeng in #18864
• fix(query): remove invalid assert and fix the error in memcpy data. by @guanshengliang in #18873
• release: build 3.0.2.0 by @guanshengliang in #18871
• fix: shell crash TD-21115 by @yihaoDeng in #18870
• fix: donot print log while assert by @guanshengliang in #18868
• fix(query): remove invalid assert and fix the error in memcpy data. by @hjxilinx in #18872
• fix(query): keep the correct value. by @guanshengliang in #18877
• release/ver-3.0.2.0 by @guanshengliang in #18878
• fix(query): return with error code if the table does not exist by @hjxilinx in #18862
• fix: show queries crash issue by @dapan1121 in #18876
• fix: control rpc qitem memory by @guanshengliang in #18874
• fix(query): does not return error code if queried table does not exists. by @guanshengliang in #18880

New Contributors

• @saivishwak made their first contribution in #18488
• @facetosea made their first contribution in #18512

Full Changelog: ver-3.0.1.8...ver-3.0.2.0