3.3.2.0
New Features/Improvements
- alter table add column can support encode and compress parameters
- Configuration parameter supportVnodes can be changed dynamically using alter command
- Minimize the impact on read/write by compact operation
- Adjust the default value of supportVnodes to 2*Cores+5
- lossyColumnn parameter is obsoleted
- Support specifying ENCODE and COMPRESS when adding columns to existing table
- Update SupportVnodes on the fly
- Support CentOS Stream
New Features/Improvements (Enterprise only)
- balance vgroup leader can be performed on a database (Enterprise only)
- Each mount point in multi-level storage can be configured as allowing new file or not (Enterprise only)
- Speed control can be set for cross-level data transfer
- IP white list can be adjusted dynamically
- New user doesn't have privilege to create database by default
- Optimized process of configuring key for database encryption
- Data compression for data transfer between TDengine 2.x and 3.x
- Data transfer from Oracle to TDengine
- Data transfer from SQL Server to TDengine
- OPC UA data points can be found and added in data in tasks dynamically
- Pi backfill task can be paused and resumed
- Pi backfill can work with data transformation
- Performance and stability improvement for Pi data in tasks
- VARBINARY and GEOMETRY data types can be used when creating tables in taos-explorer
- User can transfer user/password and privilege data between TDengine clusters using taos-explorer
- Pi data transfer supports newly added assets of an element
- taos-explorer can use native connection for the sink TDengine
- GSSAPI support for Kafka connector
- MQTT tasks can obtain sample data from the data source
- Object array support in MQTT data
- Data parsing with custom scripts
- Dynamic data filtering with plugins
Fixed Bugs
- metadata broken by TSMA
- count(*) result is wrong when filtering by supertable tags or where conditions
- The output precision is wrong of function to_iso8601()
- taosd exit abnormally because of querying first() and last() together with interval() and fill()
- Deleting a consumer group of one topic caused consumption failure of another consumer group of same name for another topic
- Column index of STMT binding over boundary caused taosd exited abnormally
- Only one parameter is changed successfully when altering multiple parameters for a table
- Union caused taosd hang when the leader is switched frequently
- Cast() caused taosd exited abnormally
- count window and sliding caused taosd exited abnormally
- Performance downgrade of group by tbname
- Other fixing for known bugs
What's Changed
- refactor(stream): opt stream sink perf. by @hjxilinx in #25598
- tsma hint add doc by @wangjiaming0909 in #25615
- fix:[TD-29893]mkdir error in mac by @wangmm0220 in #25619
- fix:[TD-29869]use latest vg info when drop topic by @wangmm0220 in #25609
- fix(stream): close task if it's in checkdown stream procedure. by @hjxilinx in #25614
- Update 12-distinguished.md by @54liuyao in #25630
- Update 12-distinguished.md by @54liuyao in #25627
- Update 06-select.md by @54liuyao in #25631
- Update 06-select.md by @54liuyao in #25632
- fix: memory leak with cmd.command and buffer by @DuanKuanJun in #25626
- Fix/fixRocksdbInitFailed3 by @yihaoDeng in #25636
- Enh: eliminate not null cond by @dapan1121 in #25639
- Test/3.0/td29157 by @zk66214 in #25637
- fix: scheduler dead lock issue by @dapan1121 in #25640
- fix(stream): set global close flag in the streamMeta. by @hjxilinx in #25646
- docs: release 3.3.0.0 by @xiaopingcs in #25651
- enh: check snap begin index against commit index on leader by @bgzhao66 in #25644
- enh: add logging info for alter vnode hash range action by @bgzhao66 in #25138
- fix: fix last col version when updating rocks by @LiShunGang in #25654
- adj delete mark by @54liuyao in #25657
- refactor: do some internal refactor. by @hjxilinx in #25653
- docs: fix link on udf page for 3.0 by @danielclow in #25157
- refactor: do some internal refactor. by @hjxilinx in #25661
- refactor: do some internal refactor. by @hjxilinx in #25666
- fix: (compatibility) SLastCol field change cause 'last' crash by @LiShunGang in #25671
- fix check ctgCache.pTsmas outside of cache read lock by @wangjiaming0909 in #25658
- fix(tsdb/cache-update): discard none colVals for same timestamp by @stephenkgu in #25675
- fix(tsdb/cache-update): compare when rocks's colVal not null by @stephenkgu in #25687
- fix: increase default query thread number by @dapan1121 in #25683
- enh: refactor tsdbCache ser/des by @LiShunGang in #25690
- fix(query): set correct row length for rowid sort. by @hjxilinx in #25679
- refactor: do some internal refactor. by @hjxilinx in #25695
- refactor: do some internal refactor. by @hjxilinx in #25700
- Td29114 by @flyingangel2013 in #25699
- fix/audit-memory-leak by @cadem in #25696
- fix: refactor lastcache ser/des for compatibility by @LiShunGang in #25707
- Test td 29035 by @happyguoxy in #25680
- fix: handle memleak in vnodeSnapWriterOpen, add log for abort_edit by @LiShunGang in #25703
- modify tsma invalid interval msg by @wangjiaming0909 in #25711
- fix(query): set the pk for interp query. by @hjxilinx in #25718
- fix(query): set correct row index. by @hjxilinx in #25728
- fix:[TD-29893]avoid returning 0 if vnode init error by @wangmm0220 in #25629
- fix:[TS-4658] make error msg specific by @wangmm0220 in #25726
- fix: change to TDengine Cloud by @DuanKuanJun in #25730
- fix: memleak by @facetosea in #25677
- fix: undefined reference to
psl_*
while linking s3 libcurl to taosd by @zitsen in #25378 - fix: build fails on macOS and Windows by @huskar-t in #25727
- add pk cases by @happyguoxy in #25720
- docs: fix anchors for 3.0 branch by @danielclow in #25744
- fix issue in makepkg.sh by @xiaopingcs in #25579
- Fix/fixCompressCompatible by @yihaoDeng in #25742
- fix(cos/oss): use vhost style uri for oss by @stephenkgu in #25746
- fix: show tags from undefined table by @kailixu in #25748
- add test case for task TD-28586 by charles by @flyingangel2013 in #25752
- fix(cos/checks3): failed early if not enabled by @stephenkgu in #25758
- feat: add pcre2 lib to precheck geometry wkt by @LiShunGang in #25471
- fix: error msg of show tags from ntb/view by @kailixu in #25764
- fix: tsdbCache vartype of zero size by @LiShunGang in #25723
- fix: race condition in dumpConfToDataBlock by @LiShunGang in #25756
- fix(tsdb): fix the length of column type overflow. by @hjxilinx in #25769
- fix/TD-29772 by @cadem in #25735
- fix(tsdb): fix deadlock when stopping reader. by @hjxilinx in #25776
- add test cases for TD-29904 by @zk66214 in #25768
- fix get table meta without meta lock by @wangjiaming0909 in #25771
- optimize scan data by @54liuyao in #25733
- enh: grant support s3/active-active/dual-replica/db_encryption by @kailixu in #25731
- enh(s3/grant): disable s3 with expired grant by @stephenkgu in #25706
- Enh/TD-29953 by @yihaoDeng in #25669
- Test/3.0/ts-4791 by @zk66214 in #25797
- upgrade taospy 2.7.15 by @menshibin in #25786
- fix:remove dot from child table in stream by @wangmm0220 in #25790
- Enh/ts 4716/timewait by @facetosea in #25773
- adj code by @54liuyao in #25792
- Test/3.0/td-29196 by @zk66214 in #25803
- fix(meta scan):check system table scan result by @54liuyao in #25808
- fix(tsim/less): use int64_t instead of int32_t for 13 digits ts by @stephenkgu in #25821
- fix partition_by_col interval not loading blocks caused crash by @wangjiaming0909 in #25788
- Update cases.task 3.0 s3Basic.py by @DuanKuanJun in #25818
- optimize stream operator checkpoint by @54liuyao in #25822
- feat/ts-4050-3.0 by @cadem in #25816
- Fix/optReadBufForQueryLargeData3 by @yihaoDeng in #25809
- Fix/backendInvalidFree by @yihaoDeng in #25798
- fix: last cache update rule by @LiShunGang in #25800
- fix(tsdb/cache): update array reference to fix missing tables/groupby by @stephenkgu in #25836
- fix: cache update for last key by @LiShunGang in #25842
- test:add last cache test in compatibility by @tomchon in #25716
- fix:[TS-4716]wait too long if change system time by @wangmm0220 in #25833
- Feat/ly_opt_checkpointYh by @yihaoDeng in #25841
- [3.0]add test cases for TD-30030 by @zk66214 in #25839
- fix:[TS-4817] check primary key(timestamp) in raw data by @wangmm0220 in #25864
- fix show create table with empty table name by @wangjiaming0909 in #25825
- enh/TD-30156 by @cadem in #25859
- fix/TD-29772 by @cadem in #25871
- fix event window operator forget filting having clause by @wangjiaming0909 in #25849
- fix:[TD-30180]error in judging if groupId already added to the end of… by @wangmm0220 in #25878
- docs: release 3.3.0.3 by @xiaopingcs in #25889
- enh(grant): refine error code by @kailixu in #25875
- Fix/fixFloatDefaultCompress by @yihaoDeng in #25883
- enh: batch update arbgroup in trans by @LiShunGang in #25879
- Test/3.0/td 30164 by @tomchon in #25856
- check delete mark by @54liuyao in #25896
- update test case to fix error occasionally by @flyingangel2013 in #25901
- fix: rectify invalid clusterId during startup by @kailixu in #25898
- fix: last cache update ts for col format by @LiShunGang in #25891
- fix/TD-30106 by @cadem in #25897
- TD-30113 by @cadem in #25894
- Fix/TD-30220 by @yihaoDeng in #25915
- fix(stream): check if outputQ is full before execute the scan history task. if it is full, idle for 5 sec. by @hjxilinx in #25910
- fix smaTest unit test by @wangjiaming0909 in #25887
- fix(stream): fix memory leak if write failed. by @hjxilinx in #25923
- enh: modify taosadapter version output by @huskar-t in #25917
- test: update stream case for subtable by @jiajingbin in #25919
- fix: last cache memory leak by @LiShunGang in #25924
- Fix/td 30190 by @dapan1121 in #25932
- add test case for ts-4806 and complicated accuracy query section by c… by @flyingangel2013 in #25936
- fix:[TD-30231]case failed in sometimes by @wangmm0220 in #25926
- fix(query): check if pSliceIno->pPrevGroupKey is initialized or not. by @hjxilinx in #25943
- enh: reduce compact block write time by @hzcheng in #25913
- compile error by @hzcheng in #25947
- fix: compact and commit concurrency problem by @hzcheng in #25958
- TS-4847: add test case by @xiaopingcs in #25961
- fix/TD-30307 by @cadem in #25957
- coverage: add test case for db encrypt by @xiaopingcs in #25971
- fix: add ut thread join by @dapan1121 in #25968
- Test/3.0/ts-4721 by @zk66214 in #25964
- Fix/TD-30317-3.0 by @hzcheng in #25974
- fix select from union all caused crash by @wangjiaming0909 in #25935
- fix: arb distinguish between isSync and acked by @LiShunGang in #25950
- Update 14-stream.md by @54liuyao in #26000
- TD-30354: update test case by @xiaopingcs in #26001
- fix: coverity scan problem by @hzcheng in #25984
- fix: memory leak by @hzcheng in #25985
- Test/3.0/td-30189 by @zk66214 in #25992
- Fix/TD-30348-30 by @yihaoDeng in #25991
- optimize tmq snapshot meta by @54liuyao in #25909
- Feat/TD-30006-3 by @yihaoDeng in #25996
- when dst table has composite primary key, need to delete result by @54liuyao in #25998
- fix exchange operator memory access problem by @wangjiaming0909 in #26006
- fix: possible coredump by @hzcheng in #26013
- fix(stream): disable stream checkpoint when related fill-history task exists. by @hjxilinx in #26019
- fix:[TD-30323]tmq close error if consumer is cleared by @wangmm0220 in #25966
- adj stream count state buff by @54liuyao in #26015
- fix: taosc exit issue by @dapan1121 in #26022
- [3.0] add test cases for TD-30188 by @zk66214 in #25994
- fix:[TD-30306]error in converity scan by @wangmm0220 in #25956
- docs:[TD-30027]modify subtable rules in stream document by @wangmm0220 in #26024
- coverity scan for stream by @54liuyao in #26021
- enh: add more log for restore by @LiShunGang in #26040
- TD-30422 by @cadem in #26032
- set scan mode for stream by @54liuyao in #26029
- fix: insert into select constant issue by @dapan1121 in #26036
- fix(stream): update the checkpoint info for followers, and some internal refactor. by @hjxilinx in #25734
- update test cases to fix uncertainty results by charles by @flyingangel2013 in #26043
- add ts column for last cache by @54liuyao in #26047
- docs:[TD-30393]add api document for tmq by @wangmm0220 in #26039
- fix: s3 with different bucket name 1~20 by @DuanKuanJun in #26056
- fix/TD-30443 by @cadem in #26051
- enh/wal_level: new level 0 to disable wal writing by @stephenkgu in #26048
- test:change the CRAN mirror site to a domestic one for R test by @tomchon in #26059
- fix:[TD-30360] drop database in the end to avoid not enough memory by @wangmm0220 in #26045
- fix:[TD-28412] change offset from earliest/-1 to earliest/0 to avoid … by @wangmm0220 in #26066
- fix defining tsma messages messing vnode commit messages by @wangjiaming0909 in #26070
- adj test case by @54liuyao in #26074
- feat(grant): support industry edition by @kailixu in #25823
- other: fix coverity issues. by @hjxilinx in #26058
- test: update stream case for TD-30382 by @jiajingbin in #26035
- fix/TD-30307 by @cadem in #26068
- fix(stream): always load the data for fill-history scan. by @hjxilinx in #26065
- fix(last_row): fix empty table condition by @stephenkgu in #26080
- fix: case coverage add column by @DuanKuanJun in #26075
- fix: compile problem for community by @kailixu in #26088
- fix invalid read by @yihaoDeng in #26026
- Fix/fixInvalidRead30 by @yihaoDeng in #26027
- fix: coverity scan issues by @dapan1121 in #26086
- fix(last_row): fix empty table condition by @stephenkgu in #26079
- fix coverity scan problem by @hzcheng in #26082
- fix: last cache rebuild from multi brinBlk by @LiShunGang in #26084
- fix: last cache rebuild from multi brinBlk by @LiShunGang in #26083
- enh(query): optimize the project query performance by @hjxilinx in #25846
- enh: support createdb permission for user by @kailixu in #26005
- enh: support get msg string and msg number by @kailixu in #26093
- enh: optimize stmt performance by @dapan1121 in #26081
- fix: select from view error by @dapan1121 in #26097
- fix: first dynamic data filter issue by @dapan1121 in #26102
- fix: first dynamic data filter issue by @dapan1121 in #26103
- docs: release 3.3.1.0 by @xiaopingcs in #26108
- docs: release 3.3.1.0 by @xiaopingcs in #26107
- limit index bg thread by @yihaoDeng in #25396
- limit index bg thread by @yihaoDeng in #25395
- Feat/TS-4971-3.0 by @yihaoDeng in #26101
- support update enableWhiteList dynamicly by @yihaoDeng in #26099
- enh: remove obsolete code by @kailixu in #25203
- fix(stream): init the node list and task list when starting mnode. by @hjxilinx in #26089
- fix: case when memory leak by @dapan1121 in #26100
- test case: mem overflow by @facetosea in #26111
- fix: reserve log file name by @kailixu in #26112
- enh: version output of taos/taosd/udfd by @kailixu in #25908
- fix: reserve log file name by @kailixu in #26106
- fix(stream): add fill-history task id in msg. by @hjxilinx in #26118
- fix industry package update issue by @xiaopingcs in #26121
- fix: select failed as using table alias name by @facetosea in #25511
- Fix/td 29671/table alias name main by @facetosea in #25667
- fix:[TD-30365] ci case error & drop topic error if vnode is splitted by @wangmm0220 in #26064
- fix:[TD-30365] ci case error & drop topic error if vnode is splitted by @wangmm0220 in #26054
- feat: data migration speed limit by @hzcheng in #26119
- fix: count always true for group by tbname performance issue by @dapan1121 in #26105
- fix: count always true for group by tbname performance issue by @dapan1121 in #26104
- fix:[TD-30579]compile error in macOS 14.5 and m3 chip by @wangmm0220 in #26124
- fix:[TD-30579]compile error in macOS 14.5 and m3 chip by @wangmm0220 in #26123
- Update 05-taosbenchmark.md by @DuanKuanJun in #26137
- fix(tsdb): check null for tsdb block load info by @hjxilinx in #26128
- fix(stream): add dispatch data monitor to handle the network broken problem that may cause the stream process frozen. by @hjxilinx in #26131
- fix(test): wait for a little bit more time. by @hjxilinx in #26147
- fix(stream): move the expansion of the stream task related task to right place. by @hjxilinx in #26150
- Update taostools_CMakeLists.txt.in-taos-tools-3.0 by @DuanKuanJun in #26155
- Fix/ts 4833/dataloaded main by @facetosea in #26126
- partition interval and limimt, dataload error by @facetosea in #26008
- Fix/td 30039/unexpected udf create by @facetosea in #26144
- Fix/td 30039/unexpected udf create main by @facetosea in #26145
- adj stream doc by @54liuyao in #26159
- adj stream doc by @54liuyao in #26158
- check cursor for count window by @54liuyao in #26135
- fix: check range option by @kailixu in #26140
- Update the libuv version to prevent compilation errors in higher versions of GCC by @yihaoDeng in #26114
- Update the libuv version to prevent compilation errors in higher versions of GCC by @yihaoDeng in #26115
- enh: support get macro string of taos errors by @kailixu in #26122
- add compress to child table by @yihaoDeng in #26138
- add compress to child table by @yihaoDeng in #26127
- double check enableWhiteList by @yihaoDeng in #26133
- double check enableWhiteList by @yihaoDeng in #26132
- fix(stream): not revise the stream id for fill-history task. by @hjxilinx in #26169
- docs: correct float compression description for 3.0 by @danielclow in #26167
- docs: correct description of float compression by @danielclow in #26166
- fix: version output of taos/taosd by @kailixu in #26172
- fix: version output of taos/taosd by @kailixu in #26170
- Test/3.0/td 30456--Increase compatibility testing CI case for message type definition values and error code values by @YamingPei in #26168
- fix(wal/level): enable alter replica from fake walLevel 1 by @stephenkgu in #26117
- fix packaging issue by @xiaopingcs in #26179
- docs: add ttl/comment spec for 'alter table' by @LiShunGang in #26176
- docs: add ttl/comment spec for 'alter table' by @LiShunGang in #26175
- fix: double covert ulong warning by @DuanKuanJun in #26183
- adj create count window state by @54liuyao in #26164
- fix(stream): fix a typo. by @hjxilinx in #26188
- optimize show cluster alive stmt by @54liuyao in #26139
- fix/TD-30542 by @cadem in #26162
- feat/TD-30542 by @cadem in #26163
- Fix/TD-30634 by @yihaoDeng in #26201
- docs: createdb permission for user by @kailixu in #26199
- fix(stream): adj stream tbname cache by @54liuyao in #26202
- Feat/ts-4954-3.0-2 by @cadem in #26178
- Fix/TD-30634-3.0 by @yihaoDeng in #26200
- fix: cast long binary crash issue by @dapan1121 in #26211
- fix(util): uncomment the timestamp decode function with AVX2 instructions by @hjxilinx in #26197
- fix: cast long binary crash issue by @dapan1121 in #26212
- tfs: support disable create new file by @kailixu in #26160
- fix/TD-30625 by @cadem in #26181
- fix(stream): clear the local backend default directory by @hjxilinx in #26218
- fix: fix window build getBuildinfo move to clieMain.c by @DuanKuanJun in #26220
- fix(util): change the load of __m128i value. by @hjxilinx in #26222
- fix(stream): not clear check downstream info. by @hjxilinx in #26224
- Update streamBackendRocksdb.c by @hjxilinx in #26225
- fix/TD-30642 by @cadem in #26192
- Fix the issue of dynamically adjusting the IP whitelist. by @yihaoDeng in #26209
- Fix the issue of dynamically adjusting the IP whitelist. by @yihaoDeng in #26206
- fix doc issue for ISNULL and NOTNULL by @zhengqin in #26231
- fix doc issue for ISNULL and NOTNULL on branch 3.0 by @zhengqin in #26234
- adj test case by @54liuyao in #26207
- fix: query hang issue cause of task set redirecting by @dapan1121 in #26228
- fix: query hang issue cause of task set redirecting by @dapan1121 in #26226
- enh: support display unlimited for expiration time by @kailixu in #26187
- fix: stmt bind crashed when colIdx exceeds column nums by @xinjiempolde in #26240
- Fix the kubernetes deployment documentation by @shiyabin in #26246
- Update 05-taosbenchmark.md thread_bind_vgroup by @DuanKuanJun in #26261
- case: add modify two three combine items by @DuanKuanJun in #26260
- add test cases for TD-30642 by @zk66214 in #26241
- fix: stmt bind crashed when colIdx exceeds column nums by @xinjiempolde in #26216
- fix(stream): disable pause if task is un-init. by @hjxilinx in #26242
- fix: compatibility for msg and error code by @kailixu in #26264
- enh: sdb table name for grant by @kailixu in #26265
- Fix/TD-30583-2-30 by @yihaoDeng in #26256
- Fix/TD-30583-2-main by @yihaoDeng in #26257
- fix:[TS-5067] check if consumer belong to this cgroup:topic where drop cgroup by @wangmm0220 in #26233
- fix:[TS-5067] check if consumer belong to this cgroup:topic where drop cgroup by @wangmm0220 in #26235
- adj test ci by @54liuyao in #26250
- fix(stream): pause not stop the start procedure of stream tasks. by @hjxilinx in #26268
- fix first last fill with ts order fault by @wangjiaming0909 in #26247
- fix first last fill with ts order fault by @wangjiaming0909 in #26213
- fix: expire time for show cluster by @kailixu in #26269
- fix(stream): do update the checkpoint info if not in checkpoint status. by @hjxilinx in #26274
- fix:[TD-30676] memory leak by @wangmm0220 in #26253
- fix(stream): update the remote checkpoint directory in snode. by @hjxilinx in #26278
- fix(stream):fill result immediately after delete data by @54liuyao in #26267
- Revert "fix(stream):fill result immediately after delete data" by @hjxilinx in #26280
- feat:[TS-4921] add slow log logic by @wangmm0220 in #26263
- fix/TD-30713 by @cadem in #26277
- fix(stream):fill result immediately after delete data by @54liuyao in #26281
- feat: 'create table' from csv file by @LiShunGang in #26275
- Merge 3.0 to main branch by @hzcheng in #26282
- fix: adjust TSDB_CODE_PAR_TBNAME_ERROR error message by @LiShunGang in #26288
- fix:compile error by @wangmm0220 in #26298
- mac installation update by @xiaopingcs in #26165
- fix:[TD-30704] null pointer error if exception occurs by @wangmm0220 in #26311
- Modify precision rules for input parameters of functions by @Simon9997 in #26284
- Add index filtering based on column value type by @yihaoDeng in #26304
- update taos-tools tag by @xiaopingcs in #26308
- fix(streamMeta): commit tdb after load tasks by @stephenkgu in #26305
- fix:[TS-4921]errors in test by @wangmm0220 in #26309
- fix(tsdb):check the result of the binary search for the end position by @hjxilinx in #26318
- fix for create table from csv by @LiShunGang in #26317
- fix:[TS-4921]errors in test & disable slow log monitor by @wangmm0220 in #26322
- enh: support centos stream by @kailixu in #26320
New Contributors
Full Changelog: ver-3.3.1.0...ver-3.3.2.0