Releases: taosdata/TDengine
3.0.5.0
Dear community members,
The past six years have been a long but exciting journey for TDengine, seeing the evolution of our product from a basic TSDB to a full-featured cloud-native solution for time-series data, and the growth of our team from a five-person startup to the 80 members of today.
Throughout our journey, our constant goal has been to provide our community with first-class products and services. Today, on TDengine’s sixth anniversary, it is with much pride that we look back on the evolution of TDengine from 1.0 to 2.0 and 3.0, from the first line of code written by Jeff himself to the hundreds of thousands of lines that now comprise our product, indicating the continuous growth of our ecosystem, the increasing maturity of features such as stream processing and data subscription, the launch of our fully managed cloud service – and, of course, the resolution of many issues brought up by community members like yourself.
And indeed, what gives our team the most satisfaction is the growth of our open-source community over the years, exemplified by our over 21,000 stars on GitHub and more than 250,000 instances installed worldwide. We are delighted that an ever-increasing number of users and developers have chosen to become members of our community and accompany us on our journey, and we would like to take this opportunity to express our sincere gratitude for your support – our greatest motivation to continue our work and accomplish our goals.
Going forward, we intend to continue innovating in the time-series database field and enabling digital transformation across more industries. It is only through your support that we will be able to deepen our understanding of the scenarios and use cases of various industries and to maintain the growth of our product in a way that aligns with the needs of our community. Once again, thank you for being there with us over the past six years, and we hope that we can count on your continuing support in the future.
The TDengine Team, 2023/Jun/6
New Features and Improvements in TDengine 3.0.5.0
- System stability & performance
- Improved system stability under high stress data writing
- Optimized system performance in some query scenarios
- Altering database replicas doesn't block writing by introducing RAFT Learner
- Write driven cache for last() and last_row() to improve the query performance
- Optimized time cost of creating/dropping database
- Log long queries by default for easy debugging
- Controlled meta data cache in taosc library
- dnode can be restored after its data is totally lost (Enterprise only)
- System security
- Privilege control at table level (Enterprise only)
- License key can be updated using SQL command by "root" (Enterprise only)
- Stream processing
- Significantly reduced disk I/O and memory usage
- Stream can be paused/resumed
- Data Subscription
- Consuming progress can be queried
- Consumers can perform seek operation
- Consumers can subscribe supertable with tag filtering
- Consumers can retrieve meta data based on a topic name
- Improved performance
- Others
- Maximum row length is increased to 64KB
- interp() can be used for super table
- Python UDF can support multiple versions with "REPLACE" command
- Partition by and window clause can be followed by "Having" clause
What's Changed
- merge main by @xiao-yu-wang in #20924
- fix: taos shell cloud ux with 3 more stars mask by @sangshuduo in #20912
- docs(taosAdapter): the automatic database creation behavior for the schemaless protocol can be configured by @huskar-t in #20929
- Update index.md to add enableScience option in taos.cfg (english) by @DuanKuanJun in #20932
- Update index.md add enableScience option to taos.cfg by @DuanKuanJun in #20931
- docs/v3.0.3.4 by @xleili in #20935
- docs: support schemaless insert by @AdamEECS in #20944
- docs update offcial doc monitor section by @sunpe in #20949
- merge main by @xiao-yu-wang in #20950
- fix: atoi on int64 config item by @sangshuduo in #20946
- enhance: udf handle expired after 10s by @shenglian-zhou in #20928
- enhance: add udf stub expiration of 10s after creation by @shenglian-zhou in #20876
- fix: illegal accesses by @huolibo in #20960
- feat: the fill value clause supports constant expressions by @xiao-yu-wang in #20961
- docs: fix for monitor doc by @sunpe in #20963
- docs: update title for monitor doc by @sunpe in #20965
- enh: add param for to_unixtimestamp to return timestamp type by @glzhao89 in #20959
- feat: last queries with tags output can be read from cache by @xiao-yu-wang in #20964
- feat: the having clause can be used after the partition by clause or window clause by @xiao-yu-wang in #20981
- enh: adjust size limit of applyQ and negotiationWin by @bgzhao66 in #20990
- enhance: package jdbc-driver for enterprise package by @xleili in #20999
- add learner by @cadem in #20971
- docs: update taoskeeper and monitor docs by @sunpe in #21004
- fix: taosbenchmark escape char for 3.0 by @sangshuduo in #21017
- pause && resume by @54liuyao in #21035
- fix: spool logging msg with pMsg->term in syncNodeOnHeartbeat by @bgzhao66 in #21038
- fix: update commit index from heartbeat on learner in the same way as on follower by @bgzhao66 in #21039
- fix(stream): set the correct start offset for stream task. by @hjxilinx in #21018
- fix/block-check-to-async-check by @cadem in #21045
- enhance: error code refactor by @shenglian-zhou in #21034
- refactor: do some internal refactor and add the sample code. by @hjxilinx in #21053
- enh: support user passwd version by @kailixu in #20828
- remove null pointer by @cadem in #21055
- docs: add docs for
taoskeeper with prometheus
by @sunpe in #21052 - enh: ignore single row null data type validation by @dapan1121 in #21059
- feat: support log slow query by default by @dapan1121 in #21057
- filter voter when agree upon by @cadem in #21073
- change learner config format by @cadem in #21069
- docs: fix tmq create database args by @AdamEECS in #21081
- enh: comment off unused error codes in sync and wal by @bgzhao66 in #21079
- enh: unify error msg for no disk space by @bgzhao66 in #21072
- feature: tag scan group and slimit by @shenglian-zhou in #21066
- docs: update connector matrix for 3.0 by @sangshuduo in #21086
- docs: fix typos and use 3.1.0 in java connector for3.0 by @sangshuduo in #21095
- sim/valgrind: suppress rocks reachables by @stephenkgu in #21091
- Update 14-stream.md by @54liuyao in #21096
- fix(taosAdapter): tmq lift blocking time limit by @huskar-t in #21101
- enhance: enterprise pull jdbc from tag 3.1.0 by @xleili in #21103
- docs:fix compile error by @dingbo8128 in #21108
- docs: release 3.0.4.1 by @xleili in #21109
- docs: release 3.0.4.1 zh by @xleili in #21112
- docs: fix build zh release history failed by @xleili in #21113
- docs(driver): jdbc error code by @huolibo in #21114
- opti:make note more specific by @wangmm0220 in #21084
- opti:make note more specific by @wangmm0220 in #21083
- opti:make note more specific by @wangmm0220 in #21082
- docs: update range for numOfCommitThreads by @sangshuduo in #21122
- docs: update taosdump doc for 3.0 by @sangshuduo in #21130
- docs: python udf docs by @shenglian-zhou in #21138
- enh: support split vgroup by @bgzhao66 in #21107
- docs: add python udf english version by @shenglian-zhou in #21151
- Update 09-udf.md by @Duanku...
3.0.4.2
Enhancements:
- Improved performance for last() without cache enabled
- Minimize the impact on data writing caused by data subscription
- Improved rebalance performance
Fixed bugs:
- taosd exit may take too much time when there is a long query
- data subscription may hang in some extreme cases
- order by _wstart with partition by doesn't work
- A few crashe problems when using stream
- The result of sum + case when is not correct
- The result of interp is incorrect
- Schemaless writing reported error "table not exist"
- taosd keeps logging "database not exist"
Full Changelog: ver-3.0.4.2...ver-3.0.4.2
What's Changed
- fix(query): check the init status for pReader->status.merger TD-23903 by @hjxilinx in #21105
- fix:[TD-23881] check the max row's length in schemaless by @wangmm0220 in #21090
- release: upgrade default version to 3.0.4.1 by @xleili in #21110
- enh(query): stop tsdb reader ASAP. TD-23249 by @hjxilinx in #21111
- fix(query): stop tsdbreade ASAP, and do some internal refactor. TD-23249 by @hjxilinx in #21116
- refactor: do some internal refactor. by @hjxilinx in #21119
- other: add some logs. by @hjxilinx in #21120
- refactor: remove assert. by @hjxilinx in #21123
- enh: optimize tbname condition by @dapan1121 in #21126
- opti:change push mgr to consume msg for subscribe by @wangmm0220 in #21060
- refactor: do some internal refactor. by @hjxilinx in #21131
- fix:change field bytes if length is bigger than 1024 by @wangmm0220 in #21137
- fix(query): stop tsdb reader asap. TD-23964 by @hjxilinx in #21148
- fix: subtable grant is not allowed by @dapan1121 in #21158
- fix(stream): secure the delete task operation. TD-23966 by @hjxilinx in #21164
- fix: stable name not responsed while stable removed issue by @dapan1121 in #21150
- update crash gen push message by @xiaopingcs in #21170
- fix(stream): opt task scan performance. by @hjxilinx in #21169
- fix(tdb/decoder): free decoder's value if not needed by user by @stephenkgu in #21167
- refactor: do some internal refactor. by @hjxilinx in #21139
- enh: declare mndSplitVgroup in mndVgroup.h by @bgzhao66 in #21172
- int16 overflow by @cadem in #21140
- fix: print float with 20 width limit by @DuanKuanJun in #21174
- fix:[TS-3277]table not exist if drop stable in another client when in… by @wangmm0220 in #21163
- fix:change field bytes if length is bigger than 1024 by @wangmm0220 in #21153
- fix:[TS-3303]use stable name + child table name as key to save uid to… by @wangmm0220 in #21152
- [TS-3140]: add test case for user privilege by @xiaopingcs in #21042
- fix: clear null bitmap bit when set value by @shenglian-zhou in #21180
- refactor: do some internal refactor. by @hjxilinx in #21183
- fix: fix taosd not exit when press ctrl+c by @glzhao89 in #21184
- fix:[TS-3347]set ver to first version if version stored is smaller th… by @wangmm0220 in #21190
- use wrong usedb map by @cadem in #21195
- test: fix tsim/db/error1.sim random failed by @DuanKuanJun in #21185
- docs: add wal args by @AdamEECS in #21203
- colid overflow by @cadem in #21206
- fix: forbid some stream computing by @shenglian-zhou in #21187
- fix: protect against nullptr in syncRespCleanRsp by @bgzhao66 in #21211
- update push message by @xiaopingcs in #21171
- fix:[TD-23972] push subscribe msg to vnode even though consumer not c… by @wangmm0220 in #21177
- fix:[TD-24010] subscribeStb.py failed in windows CI by @wangmm0220 in #21194
- fix: fix invalid read by @yihaoDeng in #21212
- fix: data compare of signed and unsigned integers by @wangjiaming0909 in #21213
- Test/update push message by @xiaopingcs in #21228
- fix: fix crash caused by tsdbReaderResume error not handled by @glzhao89 in #21224
- fix: show table distributed t; set the unit of Size to KB by @wangjiaming0909 in #21218
- fix:after restarting taosd, stream does not work. by @54liuyao in #21216
- fix:after restarting taosd, stream does not work. by @54liuyao in #21226
- fix: check varchar/nchar column length for alter normal table by @shenglian-zhou in #21221
- fix:[TD-24058]send poll result to client if no data 5 times to avoid … by @wangmm0220 in #21227
- Optimize scripts for packaging/docker by @muicoder in #21225
- fix: set telemetry reporting service url from telemetry.taosdata.com … by @wangjiaming0909 in #21219
- test:add testcases of learner in election by @tomchon in #21229
- fix: connect error when login with information_schema/performance_sc… by @wangjiaming0909 in #21232
- fix: not to set ignoring signals in dmLogCrash by @bgzhao66 in #21244
- fix: repair timestamps of wal log files in meta by @bgzhao66 in #21249
- fix:compile error in release mode by @wangmm0220 in #21252
- test: add test case by @xiaopingcs in #21251
- docs: update readme with tdengin1 wechat by @sangshuduo in #21268
- enh: remove group_key from subsidiaries if multiple different select function present by @glzhao89 in #21250
- fix: column length check when update/add column by @kailixu in #21262
- fix:[TD-24111]avoid exec pHandle task in multi query thread by @wangmm0220 in #21269
- fix: func ctgHandleGetTbMetasRsp invalid read SName by @wangjiaming0909 in #21254
- fix: bypass projection pruning if union set op and subquery by @shenglian-zhou in #21258
- fix(tmq): check handle status before close sub. by @hjxilinx in #21289
- fix: disable table count scan optimization when filters and group by both exist by @shenglian-zhou in #21283
- docs: update readme with libgflags by @sangshuduo in #21294
- refactor: do some internal refactor. by @hjxilinx in #21296
- enh(taosAdapter): update taosAdapter by @huskar-t in #21297
- fix: fix linear interpolation error by @glzhao89 in #21301
- fix: ignore crash signals in dmLogCrash by @bgzhao66 in #21309
- fix:add lock to pHandle for safety by @wangmm0220 in #21311
- Enh/tsbs perf.4 by @dapan1121 in #21271
- fix(stream):extract delete msg from wal. TD-24207 by @hjxilinx in #21314
- fix: join push down condition issue by @dapan1121 in #21346
- docs(connector-rust): update documents of connector for rust by @bioinformatist in #21345
- Update cases.task by @plum-lihui in #21356
- fix(stream): fix memory leak for stream processing. by @hjxilinx in #21359
- fix: select , <expr1##sth else> from ... return error data whe… by @wangjiaming0909 in #21310
- fix: union clause error message by @dapan1121 in #21337
- fix: memory size overflow issue by @dapan1121 in #21361
- fix: join improvement by @shenglian-zhou in #21328
- enh: optimize order by for partition by clause by @dapan1121 in https:...
3.0.4.1
Enhancements
- Performance improvement for data subscription
- User experience improvement of quitting taos shell
- Topic name of mixed lower and upper case can be subscribed
- Output format of float/double are synchronized
Fixed bugs
- "alter replica 3" hangs in some conditions
- "trim/flush database" doesn't work with multi-level storage
- Windows client can generate log file bigger than 4GB
- Some crash issues
What's Changed
- enh(stream): the stream will start after vnode restore being completed. by @hjxilinx in #20873
- fix: udf plan error by @xiao-yu-wang in #20940
- fix:stream memory leak by @54liuyao in #20953
- opti:the logic of mndDoRebalance for clear by @wangmm0220 in #20938
- chore(deps): bump spring-core from 5.3.26 to 5.3.27 in /examples/JDBC/taosdemo by @dependabot in #20955
- enh: remove unused functions in sync by @bgzhao66 in #20954
- fix(stream): set the correct initial checkpoint versions. by @hjxilinx in #20947
- fix: atoi on int64 config item for main by @sangshuduo in #20956
- fix: jdbc connector illegal accesses by @huolibo in #20962
- fix: fix double free caused crash by @glzhao89 in #20952
- fix(stream): update the reference count value to be int32 by @hjxilinx in #20967
- fix: duplicate calling shellWriteHistory by @DuanKuanJun in #20958
- enh: ignore single row null data type validation by @dapan1121 in #20973
- fix(os): fix a deadlock. by @hjxilinx in #20977
- fix: tdengine swarm cluster(3 mnodes) startup error by @lazyky in #20966
- fix: trim database db from mnd by @kailixu in #20983
- test:add testcase of compatibility.py for TS-3209 by @tomchon in #20984
- test: modify test case by @plum-lihui in #20934
- test: add cases for TS-3150 by @jiajingbin in #20911
- ci: enable Jemalloc in compilation by @tomchon in #20616
- fix: invalid identifier check by @xiao-yu-wang in #20993
- fix(stream): add lock during check wal to create new stream task. by @hjxilinx in #20995
- enh(stream): add more check to stop stream asap. by @hjxilinx in #20998
- add the cast that select field include two udf function by @DuanKuanJun in #20991
- enhance: enterprise package include jdbc driver by @xleili in #21001
- fix: do not performace table count scan optimized where there are no agg functions by @shenglian-zhou in #20989
- fix(stream): set the correct number of tasks. by @hjxilinx in #21002
- fix:[TS-3082] change offset to firstver if offset is smller than firs… by @wangmm0220 in #21006
- fix:[TS-3250] change strtegy in schemaless if modifyDBSchema error by @wangmm0220 in #21005
- opti:escape logic in schemaless by @wangmm0220 in #20970
- feat: support table_prefix/table_suffix new mode by @dapan1121 in #21007
- fix: taosdump escape dbname by @sangshuduo in #21014
- fix: topic name supports capital by @wangmm0220 in #21012
- fix: when db_name!=xxx can not be used in systable scan index by @shenglian-zhou in #21008
- fix: vnode errcode setting error by @xiao-yu-wang in #21028
- fix: taosbenchmark rest socket in stb section for main by @sangshuduo in #21020
- fix: change tdbTbInsert to tdbTbUpsert for meta update in tdb by @bgzhao66 in #21013
- fix:add log for locale setting by @cadem in #21023
- fix: release resources if node open/start failed by @kailixu in #21032
- fix filter err by @yihaoDeng in #21019
- test:modify base version in compatibility.py by @tomchon in #21044
- fix(query): add null ptr check. by @hjxilinx in #21030
- Test/ts 3249 by @happyguoxy in #21047
- fix: delete table error by @hzcheng in #21064
- fix: restore ci buildPath by @tomchon in #21067
- opti:test cases for tmq by @wangmm0220 in #21046
- enhance: packaging keeper in deb rpm main by @xleili in #21071
- fix: the latest schema may delete columns by @shenglian-zhou in #21074
- feat: subtable level privilege by @xiao-yu-wang in #21056
- fix: more fix by @hzcheng in #21078
- enh(query): opt last row read performance. TD-23313 by @hjxilinx in #21070
- fix: schema/tag version update to int32 by @dapan1121 in #21088
- fix: log file size over 4G report error on windows by @DuanKuanJun in #21077
- fix: fix crash caused by deleting from system table by @glzhao89 in #21029
- refactor: do some internal refactor. by @hjxilinx in #21087
- test:add test case for multistage by @jiacy-jcy in #20997
- Lihui3.0/test by @plum-lihui in #21094
- log: disable some logs. TD-23861 by @hjxilinx in #21097
- fix(taosAdapter): tmq lift blocking time limit by @huskar-t in #21100
- enhance: relase enterpise pull jdbc from tag 3.1.0 by @xleili in #21102
New Contributors
Full Changelog: ver-3.0.4.0...ver-3.0.4.1
3.0.4.0
Release Notes
- Significantly improved stability
- Improved performance in some query scenarios: 1) the performance of mode() when used with interval(); 2) the performance of percentile(); 3) the performance of last()/last_row()
- Rebalancing ability of cluster workloads after restarting one dnode
- Improved robustness when the data of a dnode is disrupted
- Data compact can be performed based on a specified time range
- Database parameters stt_trigger and minRows can be changed dynamically
- User defined function can be developed in Python
- Data in Pi, OPC UA and OPC DA can be transferred into TDengine
- taosExplorer can help manage data sources and tasks for Pi, OPC UA and OPC DA
What's Changed
- docs: tmq example include java code by @huolibo in #20175
- fix:create same sub table by @54liuyao in #20153
- enh: upgrade taosadapter by @sunpe in #20177
- merge main by @xiao-yu-wang in #20181
- test: check asan cases successful by @tomchon in #20189
- fix: avoid filter slow when not exist target value by @yihaoDeng in #20183
- fix: invalid vg count by @yihaoDeng in #20186
- docs: show license/vgroups docs error by @xiao-yu-wang in #20201
- Docs/xsren/ts 2750/start service des on mac by @facetosea in #20196
- merge main by @xiao-yu-wang in #20208
- enh(taosAdapter): configurable Http status code by @huskar-t in #20211
- fix: taosdump time range for 3.0 by @sangshuduo in #20218
- fix(query): fix coverity issue. by @hjxilinx in #20204
- fix: taoskeeper upper case name by @sangshuduo in #20224
- fix:error by coverity scan by @wangmm0220 in #20106
- fix(query): make exchange operator inherit input order from upstream by @glzhao89 in #20223
- docs: update telegraf dashboard doc by @sunpe in #20227
- docs: update docs for req id by @sunpe in #20210
- fix: windows release from tdengine/package/release.bat failed by @facetosea in #20233
- Update 07-tmq.mdx by @ssq001 in #19756
- docs - update social media links in readme.md by @danielclow in #19373
- Update index.md by @gechunlin in #19447
- docs:cdiwadkar16-patch-1 - example for INTERP by @cdiwadkar16 in #19934
- doc: fix markdown errors and links by @danielclow in #19807
- test: add python demo for websocket by @sunpe in #20209
- ci:add cache in ci compling by @tomchon in #20248
- docs: connector for 3.0 by @sangshuduo in #20250
- feat: add language clause for create function by @xiao-yu-wang in #20264
- docs: Update index.md by @dingbo8128 in #20274
- fix: update docs for WAL_RETENTION_PERIOD, etc. by @bgzhao66 in #20275
- update coverage test script by @xiaopingcs in #20293
- docs: clarify kafka connector branch by @sangshuduo in #20294
- enh: update taosadapter by @sunpe in #20304
- docs: release 3.0.3.0 by @xleili in #20310
- release: update 3.0 version to 3.0.3.0 by @xleili in #20312
- docs: add event window by @xiao-yu-wang in #20323
- feat: taosbenchmark support sample data per child table by @sangshuduo in #20316
- docs: add event window by @gccgdb1234 in #20324
- docs: update taosbenchmark new argument with 3.0.3.0 release by @sangshuduo in #20325
- docs: add event window by @xiao-yu-wang in #20326
- docs: this line is inaccurate, in current connector-python repo, it r… by @sangshuduo in #20336
- fix(taosAdapter): remove influxdb affected rows check by @huskar-t in #20329
- enh: coverage by @facetosea in #20307
- release: 3.0.3.0 update taostools version by @xleili in #20351
- docs: fix python version with dependencies [en] by @AdamEECS in #20339
- docs: java connector support subscription over websocket by @sangshuduo in #20362
- fix:modify description for schemaless by @wangmm0220 in #20358
- fix:modify description for schemaless by @wangmm0220 in #20359
- fix:add description of taos_get_current_db by @wangmm0220 in #20353
- fix:add description of schemaless interface by @wangmm0220 in #20354
- fix:add description of schemaless interface by @wangmm0220 in #20355
- fix:add description of taos_get_current_db by @wangmm0220 in #20348
- fix:change the default value of smlDataFormat by @wangmm0220 in #20349
- fix:change the default value of smlDataFormat by @wangmm0220 in #20350
- merge main by @xiao-yu-wang in #20320
- fix: install add explorer by @facetosea in #20357
- fix: taosbenchmark socket close properly by @sangshuduo in #20364
- docs: fix tab value and label by @sangshuduo in #20378
- docs: fix value/label in grafana doc 3.0 by @sangshuduo in #20379
- fix:symbols error by @wangmm0220 in #20382
- fix:add ins_columns by @wangmm0220 in #20384
- fix:add ins_columns by @wangmm0220 in #20385
- docs: configurable Http status code by @huskar-t in #20342
- change the 3.0 udf reference absolute path by @wingwing2005 in #20389
- fix(driver): jdbc demo adapter 3.0 by @huolibo in #20391
- docs: add tag index by @gccgdb1234 in #20395
- docs: fix login response body by @huskar-t in #20397
- docs: rename 07-index.md by @gccgdb1234 in #20400
- ci:Specify the version of the python connector by @tomchon in #20411
- fix: taosbenchmark sub on 2.6 by @sangshuduo in #20394
- merge main by @xiao-yu-wang in #20419
- fix: taos-tools gcc12 compile by @sangshuduo in #20424
- feature: python udf by @shenglian-zhou in #20265
- fix: install service path error on windows by @facetosea in #20444
- docs: Update 21-node.md show cluster alive document by @DuanKuanJun in #19268
- Update 02-database.md by @DuanKuanJun in #20458
- docs: add sc start taosd for windows by @sangshuduo in #20459
- feat: add client meta stat info by @dapan1121 in #20415
- docs: update taosbenchmark doc by @sangshuduo in #20465
- current from binary to json by @hzcheng in #20466
- docs: Update get-started doc.md by @Aries-Lee1991 in #20457
- fix: taos shell ws arg by @sangshuduo in #20480
- Do not retrieve err msg when connection is established successfully by @robotspace in #20486
- fix: windows test by @huskar-t in #20256
- docs: add doc for force fill by @gccgdb1234 in #20492
- feat: taosbenchmark support creating table interval by @sangshuduo in #20481
- Feat/td 23188 by @yihaoDeng in #20497
- fix: taosbenchmark query times incorrect by @sangshuduo in #20506
- docs: add directions of mac uninstall by @AdamEECS in #20520
- docs: add new line by @AdamEECS in #20523
- enh...
3.0.3.2
Enhancements:
- Improved stability, especially in case of high system load
- Performance improvement when querying "last() group by tbname"
- Memory usage optimization of data subscription
- Perforamnce improvement for last() and last_row()
- Optimizaed WAL cleanup for mnode
- Performance improvement for spread()
Fixed bugs:
- taosd error caused by data transfering using taosX
- dnode offline during the process of alter replica
- Client hangs after consuming all messages and then restart
- The result of FILL(LINEAR) is not consistent for incoming data and existing data
- Max() returns incorrect result
- Some other bugs
What's Changed
- fix: select ins_columns from stb/tb by @kailixu in #20561
- fix: set grant cluster info by @kailixu in #20557
- test:add test case by @jiacy-jcy in #20531
- fix: testpackage.sh install taostools script name by @xleili in #20578
- ci: enable Jemalloc in compilation by @tomchon in #20577
- fix:create same table use writemetadata interface by @wangmm0220 in #20574
- release: upgrdate default version to 3.0.3.1 by @xleili in #20581
- fix: stable with order by query limit issue by @dapan1121 in #20582
- enh: optimize table merge scan performance by @dapan1121 in #20576
- test: update coverage script by @xiaopingcs in #20594
- fix: union all translate issue by @dapan1121 in #20591
- fix: restore removed code by @dapan1121 in #20601
- fix: slimit not work issue by @dapan1121 in #20595
- fix:[TS-2961] consume error change from snapshot to wal for taosx by @wangmm0220 in #20604
- test: reopen tmqDelete-1ctb.py by @plum-lihui in #20352
- fix: set pWriter->info.state.committed as ever in vnodeSnapWriterClose by @bgzhao66 in #20598
- fix(tdb/restore): rollback journal files backward by @stephenkgu in #20608
- Fix/td 23189 by @stephenkgu in #20585
- chore(deps): bump spring-core from 5.3.20 to 5.3.26 in /examples/JDBC/taosdemo by @dependabot in #20610
- test: add tools to detect the validity of ASSERT by @DuanKuanJun in #20573
- fix: taosbenchmark support same min/max for main by @sangshuduo in #20621
- fix(tmq): wait for 2mins when subscribe topics. by @hjxilinx in #20628
- fix: query ins_table with table_name = '' results in db error by @shenglian-zhou in #20606
- fix: change float display mode by @dapan1121 in #20618
- fix:reset parameter ignoreExpried for fill history by @54liuyao in #20620
- fix: modify stream fill linear by @54liuyao in #20625
- fix:add combine function for groupKey by @54liuyao in #20605
- fix:scan of fill history ended prematurely by @54liuyao in #20527
- fix:send data batch if consume wal where subscribe db by @wangmm0220 in #20627
- fix: recorect ci buildPath by @tomchon in #20635
- fix: enterprise version displays the associated community version gitinfo by @xiao-yu-wang in #20643
- fix: create stream does not support event_window by @xiao-yu-wang in #20656
- fix: taosbenchmark codacy complain for main by @sangshuduo in #20647
- enh: disable timely vnodeCommit by @bgzhao66 in #20613
- fix: fix cfg load enviroment variables crash when environ is NULL by @glzhao89 in #20653
- fix:add test case for raw_block interface by @wangmm0220 in #20642
- fix(tmq): kill the ongoing tsdb scans while transferring the ownership of vnode to other consumers. by @hjxilinx in #20666
- refactor: do some internal refactor. by @hjxilinx in #20670
- fix: taosToolsInstallDir if condition order by @xleili in #20665
- fix(query): spread/elapsed using sma result for computation by @glzhao89 in #20668
- fix: post script add jemalloc by @sangshuduo in #20672
- refactor: do some internal refactor. by @hjxilinx in #20673
- fix:add combine function for last row by @54liuyao in #20649
- fix:[TD-23339] parse block error by @wangmm0220 in #20677
- feat:coverity scan by @54liuyao in #20658
- enh: separate sync read and write by @bgzhao66 in #20678
- fix: telnet_tcp and sml_json_all_types for main by @sangshuduo in #20661
- fix: query schema is old issue by @dapan1121 in #20674
- fix(query): allow only one trans to be execute for each balance, and do some other refactor. by @hjxilinx in #20679
- fix: hotfix version compatibility by @xiao-yu-wang in #20683
- fix(tsdb/read): use correct scheme for mem & imem merging by @stephenkgu in #20686
- test: refine query cases by @happyguoxy in #20693
- fix: tag copy issue by @dapan1121 in #20697
- fix: add more column update cases by @dapan1121 in #20703
- fix:add assert for debug by @wangmm0220 in #20699
- fix: join before interval by @shenglian-zhou in #20698
- fix(stream):fix the race condition when creating new tables. by @hjxilinx in #20691
- Test/td 22592 by @happyguoxy in #20702
- fix: error in determining whether last(t.*) is a selection function by @xiao-yu-wang in #20685
- enh: optimize count performance by @dapan1121 in #20690
- Lihui3.0/test by @plum-lihui in #20706
- fix: add filter to exchange node for union-all subquery by @shenglian-zhou in #20708
- chore: update taos-tools d194dc9 for main by @sangshuduo in #20713
- fix: join query invalid time input issue by @dapan1121 in #20714
- fix(query): fix group_key is processed in selectivity twice by @glzhao89 in #20715
- enh(taosAdapter): TMQ parameter adjustment by @huskar-t in #20710
- fix:state window return wrong block type by @54liuyao in #20707
- fix:int64 parse error in schemaless by @wangmm0220 in #20717
- opti:disable set enable.heartbeat.background by @wangmm0220 in #20700
- fix:[TS-3038] coredump if nchar data not clear SColVal in schemaless by @wangmm0220 in #20719
- fix: task context not exists issue by @dapan1121 in #20725
- fix(tmq): build sync api on top of async APIs. by @hjxilinx in #20722
- fix: error in optimizing useless columns for multi-level set operators by @xiao-yu-wang in #20724
- enh: convert the month and year in interval-offset to a database precision duration by @xiao-yu-wang in #20733
- Feature/3 liaohj by @hjxilinx in #20730
- fix: taosbenchmark multithreads with limit for main by @sangshuduo in #20744
- enh: last_row is keep order function by @xiao-yu-wang in #20747
- fix coverity scan problem by @yihaoDeng in #20519
- fix(query): fix interp tsdbReader external range not setting properly by @glzhao89 in #20739
- ehn(plan/optimizer): remove tbname fetching with cached groupby by @stephenkgu in #20748
- fix: aovid conn leak by @yihaoDeng in #20749
- fix: add stmt error handling by @dapan1121 in #20750
Full Changelog: ver-3.0.3.1...ver-3.0.3.2
3.0.3.1
Enhancements:
- Adjusted the behavior of limit/slimit with group by to be compatible with 2.x
- Performance improvement for count(1)
Fixed bugs:
- non-root user query information_schema.ins_dnodes caused client crash
- group by tag with limit doesn't work
- last() result is not correct when queryPolicy is set to 3
- filter for non-key timestamp caused too many window
- Errors reported in writing with schemaless
- Stream doens't work after the table schema was altered
- Group by doesn't return expected result
- Improper error message was reported when using order by
What's Changed
- enh: keep extra raft Logs before minimum match index by @bgzhao66 in #20314
- test: modify tmq test cases by @plum-lihui in #20343
- fix: remove test case has random results by @glzhao89 in #20345
- remove log by @yihaoDeng in #20322
- fix: all columns are invisiable in system table query by @dapan1121 in #20360
- enh: no need to wait for emptying apply queue in syncNodePreClose by @bgzhao66 in #20346
- fix: unit sma and tag index error msg by @yihaoDeng in #20335
- fix(query): fix scalar calculation crash in stream when input rows is 0 by @glzhao89 in #20341
- fix:fill history check update by @54liuyao in #20344
- fix: cus prompt length lead hang by @sangshuduo in #20371
- fix:add error log by @wangmm0220 in #20375
- fix: taosbenchmark socket close properly for main by @sangshuduo in #20365
- feat: alter stt trigger and min rows by @hzcheng in #20367
- fix:[TS-2828] retry if ver is old by @wangmm0220 in #20376
- fix:get dest table version by @54liuyao in #20373
- fix: TIMETRUNCATE with 1d return unexpected result by @huskar-t in #20363
- enh: optimize last/last_row cost when the cache was first loaded by @xiao-yu-wang in #20372
- enh: add user err code by @yihaoDeng in #20381
- fix:add log by @wangmm0220 in #20383
- enh: optimize last/last_row cost when the cache was first loaded by @xiao-yu-wang in #20387
- add user err code by @yihaoDeng in #20390
- ci:Specify the version of the python connector by @tomchon in #20407
- ci:Specify the version of the python connector by @tomchon in #20408
- enh: optimize snapshot transfer by @hzcheng in #20398
- fix: invalid topic query by @xiao-yu-wang in #20403
- fix: error in last cache handle deleted data by @xiao-yu-wang in #20401
- fix: taosbenchmark sub on 2.6 for main by @sangshuduo in #20409
- fix: taos-tools gcc 12 compile for main by @sangshuduo in #20425
- Add the Chinese version of CODE_OF_CONDUCT.md by @EchoHou2000 in #18572
- change tag index case by @yihaoDeng in #20416
- feat: correct slimit&limit clause by @dapan1121 in #20414
- fix:add log for taosx by @wangmm0220 in #20445
- fix: add version to udfd conn req by @shenglian-zhou in #20443
- enh: adjust the error msgs of sync not leader and sync is restoring by @bgzhao66 in #20442
- fix:deal with ASSERT in tmq by @wangmm0220 in #20418
- enh: not allow to propose if fsm applying progress lagging behind too far by @bgzhao66 in #20413
- fix(query): remove assert by @glzhao89 in #20396
- fix:auto fill null column by @54liuyao in #20412
- ci: add successful log by @tomchon in #20417
- Update index.md by @changxiaoqiang in #20436
- fix: last redundant read stt file by @xiao-yu-wang in #20427
- Feature/xsren/win install error base main by @facetosea in #20450
- chore: support cus name by @sangshuduo in #20441
- fix(tmq): fix some race condition and do some internal refactor. by @hjxilinx in #20422
- fix:create same sub table by @54liuyao in #20467
- fix: fix table count operator groupId issue by @dapan1121 in #20463
- fix:source task needs to wait && stream state window does not handle null by @54liuyao in #20464
- fix:use table suid in taosx to avoid suid is not same for using suid by @wangmm0220 in #20460
- fix: fix coverity scan by @54liuyao in #20451
- fix: return err msg while db is creating by @yihaoDeng in #20280
- test: update requirements by @AdamEECS in #20470
- fix(query): set the correct cached tags list key length, and update s… by @hjxilinx in #20472
- fix: alter minrows doesn't take effect by @guanshengliang in #20471
- enh(tsdb/cache): skip invalid datablock directly when traversing fs with last by @stephenkgu in #20476
- test:reduce to 1000 rowNumbers per tables in testcases by @tomchon in #20462
- fix(tmq): disable non-leader vnode responsing the poll request. by @hjxilinx in #20490
- ehn(tsdb/cache): load necessary columns only by @stephenkgu in #20493
- fix(query): invalid write when query of ins_columns by @kailixu in #20485
- fix(tmq): adjust the time out value check. by @hjxilinx in #20495
- feat: taosbenchmark support creating table interval for main by @sangshuduo in #20482
- test:fix that timestamps can be validated correctly in testcase by @tomchon in #20487
- fix(tmq): release the tmq properly, and add some logs for subscription. by @hjxilinx in #20496
- fix(client): set the initial value for num_of_rows. by @hjxilinx in #20502
- ehn(tsdb/cache): skip invalid row or data block directly with merge tree by @stephenkgu in #20505
- fix: modify minrows/maxrows range and add cases by @dapan1121 in #20488
- fix: taosbenchmark query times incorrect for main by @sangshuduo in #20507
- fix: order by error info by @dapan1121 in #20515
- enh: optimize count(1) performance by @dapan1121 in #20509
- fix: add sma load time by @dapan1121 in #20516
- fix: client invalid write issue by @dapan1121 in #20512
- test: add case for TS-2687 wide column by @DuanKuanJun in #20494
- fix: truncate of server version by @kailixu in #20522
- fix(query): do not update ts window at exchange operator. by @glzhao89 in #20526
- fix(tsdb/cache): update nCols of merge tree to avoid assert failed by @stephenkgu in #20539
- enh: optimize last pruning logic by @xiao-yu-wang in #20542
- fix: improve taos shell user experience for connecting cloud by @sangshuduo in #20528
- enh: optimize last pruning logic by @xiao-yu-wang in #20543
- Revert "fix(query): invalid write when query of ins_columns" by @kailixu in #20537
- test: assert check tools by @DuanKuanJun in #20536
- test:add failed connection of client and server by @tomchon in #20535
- test:add tsbs query sql by @tomchon in #20547
- fix:converity scan defects by @wangmm0220 in #20513
- fix(client): fix potential memory leak. by @hjxilinx in #20508
- fix: add retry if insert error with meta change by @wangmm0220 in #20554
- chore: fix script to get latest tag by @sangshuduo in https://github.com/taosdata/TDengine/p...
3.0.3.0
New Features:
- You can now create windowed queries that are triggered by events - just specify any conditions that TDengine supports, including operations on different columns.
- Indexing on any tag: You can now create an index on any tag, enabling improved query performance when filtering by tag.
- (Enterprise Edition only) Data compaction: TDengine Enterprise Edition now provides the COMPACT statement to reorganize your database and remove gaps from deleted or updated records. This can greatly improve storage and query performance on deployments that have been running for some time.
- (Enterprise Edition only) TDengine Explorer: TDengine Enterprise Edition now offers a convenient GUI to make ad hoc time-series operations and instance management even easier.
- (Enterprise Edition only) Local backup and migration: The latest version of taosX included with TDengine Enterprise Edition 3.0.3.0 can back up and restore a TDengine deployment from a local file. taosX can also migrate data from existing TDengine 2.6 or 3.x deployments to TDengine 3.0.3.0, either incrementally or in full.
Enhancements:
- Results of stream processing can be stored in existing stables
- You can specify tags when storing the results of stream processing
- Data can be subscribed over websocket using Java Connector
- Data can be subscribed over websocket using Python Connector
- You can monitor HTTP status code on Grafana Dashboard
- Grafana plugin supports multi-dimensional alerts
- taosBenchmark can write data into sepcified range of child tables
- taosBenchmark can specify the number of vgroups on command line
What's Changed
- enh: replace row format by @xiao-yu-wang in #18498
- enh: replace row format by @xiao-yu-wang in #18506
- enh: insert row format by @xiao-yu-wang in #18531
- enh: insert row format by @xiao-yu-wang in #18547
- enh: add table blokc order check by @xiao-yu-wang in #18559
- merge 3.0 by @xiao-yu-wang in #18560
- fix:merge from submit_req by @wangmm0220 in #18650
- fix:submit req by @wangmm0220 in #18660
- fix: add logic for schemaless by @wangmm0220 in #18665
- fix:rm useless code by @wangmm0220 in #18669
- refact: tsma/rsma process and result adaption by @kailixu in #18666
- fix: insert float error by @xiao-yu-wang in #18673
- fix:merge submit req by @wangmm0220 in #18718
- fix: memory leak by @xiao-yu-wang in #18748
- fix: insert varchar error by @xiao-yu-wang in #18753
- fix: merge conflict by @xiao-yu-wang in #18781
- fix: insert row format error by @xiao-yu-wang in #18795
- opti:performance of schemaless by @wangmm0220 in #18833
- fix:merge from submit_req by @wangmm0220 in #18839
- docs: add 3.0.3 & 2.0.42 version desc by @huolibo in #18856
- docs: update taosadapter document for schemaless ttl by @sunpe in #18726
- docs:release 3.0.2.0 by @xleili in #18866
- merge from main to 3.0 by @guanshengliang in #18863
- doc: correct configuration parameters by @gccgdb1234 in #18883
- doc: reorganize 3.0 configuration parameters by @gccgdb1234 in #18884
- merge from main to 3.0 by @guanshengliang in #18885
- doc: remove minSlidingTime and minIntervalTime by @gccgdb1234 in #18888
- doc: add compressMsgSize back by @gccgdb1234 in #18896
- fix: taosbenchmark rest insert mode in json by @sangshuduo in #18892
- opti:split clientSml.c to 3 files & modify unit test cases for sml by @wangmm0220 in #18912
- fix:error in CI by @wangmm0220 in #18913
- merge from main to 3.0 by @guanshengliang in #18907
- FIX:TS-2258-mac cpuinfo has an extra enter character by @facetosea in #18916
- test: remove compatibility test from coverage test by @xiaopingcs in #18922
- docs: fix taosdump download link for 3.0 by @sangshuduo in #18930
- docs: taosbenchmark retry by @sangshuduo in #18931
- docs: fix tools download link by @sangshuduo in #18932
- feat: event window query by @xiao-yu-wang in #18925
- fix: taos shell show reconnect after tried twice by @sangshuduo in #18934
- fix:Update 50-opentsdb-json.mdx by @wangmm0220 in #18941
- fix:Update 50-opentsdb-json.mdx by @wangmm0220 in #18942
- fix: taos shell ws take timing with null inputed by @sangshuduo in #18957
- fix: taosbenchmark min max delay by @sangshuduo in #18967
- modify: add comma by @KelvinYin in #18964
- fix: taosbenchmark disorder by @sangshuduo in #18987
- docs(stream) by @cosmic-jc in #18993
- merge main by @xiao-yu-wang in #18996
- fix: taosbenchmark delay time on windows by @sangshuduo in #19002
- opti:schemaless logic by @wangmm0220 in #19005
- fix: modify test cases by @wangmm0220 in #19007
- fix(tdb): rollback in-memory pages by @stephenkgu in #19009
- enh: tsma support first/last/count functions by @xiao-yu-wang in #19008
- doc: update 04-stable.md by @tomchon in #19012
- test: add test case for leastsquares by @xiaopingcs in #18969
- docs: update go tmq demo by @sunpe in #19018
- fix: taosbenchmark disorder rec dup by @sangshuduo in #19014
- feat(query): add _isfilled pseudocolumn to indicate data is origin by @glzhao89 in #18958
- docs: update schemaless api for ttl by @sunpe in #18901
- enh(taosAdapter): return 502 when Unable to establish connection error occurs by @huskar-t in #19026
- test:add testcase of mnode clusters by @tomchon in #18977
- fix:error in windows by @wangmm0220 in #19031
- enh: java connector support get table vgid by @sunpe in #18981
- merge from main to 3.0 by @guanshengliang in #19030
- fix:smlTest unit test by @wangmm0220 in #19037
- docs: update default trigger mode by @jiajingbin in #19039
- chore: release script for mac by @sangshuduo in #19047
- enh: improve unit tests by @xiao-yu-wang in #19042
- enh: update taosadapter by @sunpe in #19051
- fix/mac_m1_enterprise by @facetosea in #19062
- docs: release 3.0.2.1 by @xleili in #19075
- enh: improve unit tests by @xiao-yu-wang in #19070
- fix: merge from submit req by @wangmm0220 in #19080
- fix:merge error by @wangmm0220 in #19082
- refactor: remove assert by @cosmic-jc in #19059
- opti:taosx for write_raw_block by @wangmm0220 in #19091
- refactor: add debug log by @cosmic-jc in #19094
- Update 24-show.md show table distributed by @DuanKuanJun in #19110
- test: update script to stop taosadapter service by @xiaopingcs in #19072
- Update 24-show.md by @DuanKuanJun in #19112
- fix:add test case for TS-2035 by @wangmm0220 in #19118
- merge 3.0 by @xiao-yu-wang in #19117
- fix: taosdump data schema on windows by @sangshuduo in #19123
- fix: windows taosdump refine cmake by @sangshuduo in #19129
- fix: taosbenchmark bigint random by @sangshuduo in https:/...
3.0.2.6
Enhancements:
N/A
Fixed Bugs:
- The result of max() are not consistent between first + max + interval(1d) and last + max + interval(1d)
- join across multiple databases hangs
- invalid values of consumer_id and vgroup_id are returned in "show subscriptions"
- data ingestion may be blocked because of many concurrent queries
- taosd OOM after long time running with stream and data ingestion
- stable can't be deleted even there isn't topic on it
- "table doesn't exist" is returned when "show table distributed" for an existing normal table
- Result is wrong when querying "order by ts desc"
- Result is wrong when querying last_row() on a supertable
3.0.2.5
Enhancements:
- tar.gz installer can detect RPM/Deb installation and remove them per user's confirmation
- Performance improvement of partition by
- Performance improvement of "select * limit 0"
- Performance improvement of "select count(*)" when there is out-of-order data
- Performance improvement for query by caching head files
Fixed Bugs:
- taosd crashs when querying information_schema with filter conditions
- taosd crashs when inserting data rows with duplicate timestamp in some extreme cases
- taosd crashs when executing some very complicated queries
- taosd crashs on Windows
- keepColumnName doesn't work in sub-query
- min(), max() and some functions don't return correct result when all data are in data files
- taoskeeper failed to start because "create database" is not executed prior to "create table" in some cases
- Some memory leak problems in taosd
- Memory leak in taosadpater when using line protocol
- No result is returned using "order by asc limit offset"
- interp() doesn't work properly in sub-query
- Error "WAL failed to remove log file" on Windows
- A lot of internal bugs to improve stability
3.0.2.4
Improvements:
- "show cluster" can display "version" and "expired" fields
Fixed Bugs:
- "show create database" doesn't display "STT_TRIGGER" parameter
- Application using JAVA connector crashed after upgrading to 3.0.2.3
- "insert into d1 select * from d0" caused taosd hang
- oom of taosadapter while running data replication