3.0.4.0

Release Notes

1. Significantly improved stability
2. Improved performance in some query scenarios: 1) the performance of mode() when used with interval(); 2) the performance of percentile(); 3) the performance of last()/last_row()
3. Rebalancing ability of cluster workloads after restarting one dnode
4. Improved robustness when the data of a dnode is disrupted
5. Data compact can be performed based on a specified time range
6. Database parameters stt_trigger and minRows can be changed dynamically
7. User defined function can be developed in Python
8. Data in Pi, OPC UA and OPC DA can be transferred into TDengine
9. taosExplorer can help manage data sources and tasks for Pi, OPC UA and OPC DA

What's Changed

• docs: tmq example include java code by @huolibo in #20175
• fix:create same sub table by @54liuyao in #20153
• enh: upgrade taosadapter by @sunpe in #20177
• merge main by @xiao-yu-wang in #20181
• test: check asan cases successful by @tomchon in #20189
• fix: avoid filter slow when not exist target value by @yihaoDeng in #20183
• fix: invalid vg count by @yihaoDeng in #20186
• docs: show license/vgroups docs error by @xiao-yu-wang in #20201
• Docs/xsren/ts 2750/start service des on mac by @facetosea in #20196
• merge main by @xiao-yu-wang in #20208
• enh(taosAdapter): configurable Http status code by @huskar-t in #20211
• fix: taosdump time range for 3.0 by @sangshuduo in #20218
• fix(query): fix coverity issue. by @hjxilinx in #20204
• fix: taoskeeper upper case name by @sangshuduo in #20224
• fix:error by coverity scan by @wangmm0220 in #20106
• fix(query): make exchange operator inherit input order from upstream by @glzhao89 in #20223
• docs: update telegraf dashboard doc by @sunpe in #20227
• docs: update docs for req id by @sunpe in #20210
• fix: windows release from tdengine/package/release.bat failed by @facetosea in #20233
• Update 07-tmq.mdx by @ssq001 in #19756
• docs - update social media links in readme.md by @danielclow in #19373
• Update index.md by @gechunlin in #19447
• docs:cdiwadkar16-patch-1 - example for INTERP by @cdiwadkar16 in #19934
• doc: fix markdown errors and links by @danielclow in #19807
• test: add python demo for websocket by @sunpe in #20209
• ci:add cache in ci compling by @tomchon in #20248
• docs: connector for 3.0 by @sangshuduo in #20250
• feat: add language clause for create function by @xiao-yu-wang in #20264
• docs: Update index.md by @dingbo8128 in #20274
• fix: update docs for WAL_RETENTION_PERIOD, etc. by @bgzhao66 in #20275
• update coverage test script by @xiaopingcs in #20293
• docs: clarify kafka connector branch by @sangshuduo in #20294
• enh: update taosadapter by @sunpe in #20304
• docs: release 3.0.3.0 by @xleili in #20310
• release: update 3.0 version to 3.0.3.0 by @xleili in #20312
• docs: add event window by @xiao-yu-wang in #20323
• feat: taosbenchmark support sample data per child table by @sangshuduo in #20316
• docs: add event window by @gccgdb1234 in #20324
• docs: update taosbenchmark new argument with 3.0.3.0 release by @sangshuduo in #20325
• docs: add event window by @xiao-yu-wang in #20326
• docs: this line is inaccurate, in current connector-python repo, it r… by @sangshuduo in #20336
• fix(taosAdapter): remove influxdb affected rows check by @huskar-t in #20329
• enh: coverage by @facetosea in #20307
• release: 3.0.3.0 update taostools version by @xleili in #20351
• docs: fix python version with dependencies [en] by @AdamEECS in #20339
• docs: java connector support subscription over websocket by @sangshuduo in #20362
• fix:modify description for schemaless by @wangmm0220 in #20358
• fix:modify description for schemaless by @wangmm0220 in #20359
• fix:add description of taos_get_current_db by @wangmm0220 in #20353
• fix:add description of schemaless interface by @wangmm0220 in #20354
• fix:add description of schemaless interface by @wangmm0220 in #20355
• fix:add description of taos_get_current_db by @wangmm0220 in #20348
• fix:change the default value of smlDataFormat by @wangmm0220 in #20349
• fix:change the default value of smlDataFormat by @wangmm0220 in #20350
• merge main by @xiao-yu-wang in #20320
• fix: install add explorer by @facetosea in #20357
• fix: taosbenchmark socket close properly by @sangshuduo in #20364
• docs: fix tab value and label by @sangshuduo in #20378
• docs: fix value/label in grafana doc 3.0 by @sangshuduo in #20379
• fix:symbols error by @wangmm0220 in #20382
• fix:add ins_columns by @wangmm0220 in #20384
• fix:add ins_columns by @wangmm0220 in #20385
• docs: configurable Http status code by @huskar-t in #20342
• change the 3.0 udf reference absolute path by @wingwing2005 in #20389
• fix(driver): jdbc demo adapter 3.0 by @huolibo in #20391
• docs: add tag index by @gccgdb1234 in #20395
• docs: fix login response body by @huskar-t in #20397
• docs: rename 07-index.md by @gccgdb1234 in #20400
• ci:Specify the version of the python connector by @tomchon in #20411
• fix: taosbenchmark sub on 2.6 by @sangshuduo in #20394
• merge main by @xiao-yu-wang in #20419
• fix: taos-tools gcc12 compile by @sangshuduo in #20424
• feature: python udf by @shenglian-zhou in #20265
• fix: install service path error on windows by @facetosea in #20444
• docs: Update 21-node.md show cluster alive document by @DuanKuanJun in #19268
• Update 02-database.md by @DuanKuanJun in #20458
• docs: add sc start taosd for windows by @sangshuduo in #20459
• feat: add client meta stat info by @dapan1121 in #20415
• docs: update taosbenchmark doc by @sangshuduo in #20465
• current from binary to json by @hzcheng in #20466
• docs: Update get-started doc.md by @Aries-Lee1991 in #20457
• fix: taos shell ws arg by @sangshuduo in #20480
• Do not retrieve err msg when connection is established successfully by @robotspace in #20486
• fix: windows test by @huskar-t in #20256
• docs: add doc for force fill by @gccgdb1234 in #20492
• feat: taosbenchmark support creating table interval by @sangshuduo in #20481
• Feat/td 23188 by @yihaoDeng in #20497
• fix: taosbenchmark query times incorrect by @sangshuduo in #20506
• docs: add directions of mac uninstall by @AdamEECS in #20520
• docs: add new line by @AdamEECS in #20523
• enhance: add taospyudf test and run it in CI by @shenglian-zhou in #20498
• fix: codeql complain python code cwe by @sangshuduo in #20525
• update taos.tar.gz to package.tar.gz by @xleili in #20511
• feat/add topic total and stream total in monitor by @cadem in #20530
• docs: add flush database doc by @xiao-yu-wang in #20545
• docs: refien tmq configuration by @gccgdb1234 in #20551
• docs: refine tmq configuration by @gccgdb1234 in #20553
• fix:add tips for tmq consume by @wangmm0220 in #20540
• fix:add tips for tmq consume by @wangmm0220 in #20541
• enhance: add udf context from plugin traceability by @shenglian-zhou in #20538
• feat(driver): add schemaless raw insert for jdbc by @huolibo in #20552
• docs: append ws doc for python connector by @sangshuduo in #20572
• docs: fix connector python install version 3.0 by @sangshuduo in #20575
• chore: fix script to get latest tag by @sangshuduo in #20567
• feat: alter database wal_retention_period/wal_retention_size by @xiao-yu-wang in #20571
• docs: release 3.0.3.1 by @xleili in #20580
• fix: create function error for json/decimal/blob/varbinary type by @shenglian-zhou in #20570
• feat: add sql command 'balance vgroup leader' by @xiao-yu-wang in #20584
• docs: add taoskeeper start as service by @xleili in #20588
• merge 3.0 by @xiao-yu-wang in #20590
• feat: add sql command 'balance vgroup leader' by @cadem in #20589
• enh(query): improve mode function page buffer allocation by @glzhao89 in #20569
• enh: corrent slimit/limit statement by @dapan1121 in #20592
• feat: support WAL_RETENTION_PERIOD and WAL_RETENTION_SIZE for alter database by @bgzhao66 in #20593
• fix: merge main to 3.0 by @dapan1121 in #20599
• fix: udf error check by @xiao-yu-wang in #20603
• fix: taosbenchmark same min max by @sangshuduo in #20619
• docs: refine en/13-operation/01-pkg-install.md by @sangshuduo in #20631
• fix: aggregate function can return null value by @shenglian-zhou in #20596
• fix: clusterid isolation by @cadem in #20524
• fix: fix windows handling localtime_s error by @glzhao89 in #20623
• docs: fix event window doc by @xiao-yu-wang in #20641
• Fix/trigger election by sync msg by @cadem in #20615
• fix: taosbenchmark codacy complain by @sangshuduo in #20640
• docs: add content about req-id on version 3.0 by @AdamEECS in #20650
• feat: WAL cleanup not affected by topic consumption anymore by @bgzhao66 in #20607
• wrong field logging by @cadem in #20652
• fix: taosbenchmark telnet_tcp case by @sangshuduo in #20659
• docs: refine the description about disaster recovery by @gccgdb1234 in #20675
• fix: fix test cast.py for windows by @huskar-t in #20676
• docs: update taoskeeper docs installation part by @sangshuduo in #20680
• docs: add taoskeeper note for monitor parameter by @sangshuduo in #20633
• fix: taosdump free tbname in loose mode by @sangshuduo in #20681
• test : udf for python add ci case udfpy_main.py by @DuanKuanJun in #20662
• enhance: add language and body to ins_functions by @shenglian-zhou in #20669
• chore: refactor cus prompt by @sangshuduo in #20688
• enh(taosAdapter): TMQ parameter adjustment by @huskar-t in #20711
• update xiao-t's img by @changxiaoqiang in #20562
• Infactor Lua connection pool implementation. by @robotspace in #20720
• Revert "current from binary to json" by @hzcheng in #20721
• docs: update docs for tdinsight and taoskeeper by @sunpe in #20738
• chore: fix cus name by @sangshuduo in #20716
• fix: taosbenchmark multithreadfs with limit specified by @sangshuduo in #20743
• change msg order by @cadem in #20602
• Update 20-keywords.md by @liuyq-617 in #20645
• feat: table level privilege check by @xiao-yu-wang in #20769
• refactor: do some internal refactor. by @hjxilinx in #20745
• docs: release 3.0.3.2 by @xleili in #20765
• release: upgrade 3.0 default version to 3.0.3.2 by @xleili in #20768
• docs/3.0.3.2 by @xleili in #20776
• fix: column comment is not supported by @xiao-yu-wang in #20771
• fix: fix tsim crash on windows due to invalid input to strftime by @glzhao89 in #20742
• release: upgrade default version to 3.0.3.2 by @xleili in #20766
• chore: cus name support in shellArgument by @sangshuduo in #20754
• fix: taosbenchmark disorder dynamic range for main by @sangshuduo in #20774
• fix: taosbenchmark disrange dynamic by @sangshuduo in #20772
• fix:error in TD-23218 & remove useless logic by @wangmm0220 in #20534
• fix:tq memory leak by @54liuyao in #20775
• fix: taosbenchmark childtbl from/to by @sangshuduo in #20779
• fix: taosbenchmark child from/to for main by @sangshuduo in #20780
• feat: add 'or replace' clause to 'create function' statement by @xiao-yu-wang in #20770
• fix: benchmark from to main by @sangshuduo in #20784
• fix: benchmark from to by @sangshuduo in #20786
• merge main by @xiao-yu-wang in #20756
• refactor: erase unnecessary error log. by @hjxilinx in #20789
• fix: install script by @sangshuduo in #20794
• fix: interp pseudo column can not be used without interp function by @shenglian-zhou in #20758
• fix:remove smlChildTableName from tag by @wangmm0220 in #20792
• fix:time_wait in doAskEp by @wangmm0220 in #20795
• enh: refactor some func names of syncLogReplMgr by @bgzhao66 in #20793
• fix: delete column comment syntax by @xiao-yu-wang in #20799
• docs: update description of parameters WAL_RETENTION_PERIOD etc. by @bgzhao66 in #20764
• feat: table level privilege by @xiao-yu-wang in #20804
• the strategy for wal retention period and size by @DuanKuanJun in #20740
• fix: taosbenchmark neg value in json by @sangshuduo in #20796
• fix: taosbenchmark from/to neg value for main by @sangshuduo in #20805
• test: change random to fixed by @DuanKuanJun in #20801
• fix(tsdb/row merger): rewrite row merger and fix tsdb read crash with schemaless by @stephenkgu in #20798
• fix:[TD-23517] set offset type to wal if only meta & check if tag is … by @wangmm0220 in #20809
• chore: release script community main by @sangshuduo in #20808
• docs(driver-go): fix dsn param by @huskar-t in #20813
• fix: table level privilege by @xiao-yu-wang in #20816
• fix: set block allocated to false for each call to downstream operator by @shenglian-zhou in #20819
• fix: cfg name release script community main by @sangshuduo in #20818
• fix: fix nullbitmap shift error when trimming data blocks. by @glzhao89 in #20814
• fix: taosdump in diff type for main by @sangshuduo in #20825
• fix: taosdump in diff type by @sangshuduo in #20823
• feat(release): install taosx and taos-explorer service for enterprise by @zitsen in #20829
• test:add testcase of childtale_from_to by @tomchon in #20817
• merge main by @xiao-yu-wang in #20830
• fix(tsdb/read): use the correct schema with multilevel merging by @stephenkgu in #20812
• fix:add tools to checkout tmq offset & add error log for tmq by @wangmm0220 in #20820
• fix: catalog unit test by @xiao-yu-wang in #20835
• fix: remove unused macros by @sangshuduo in #20839
• fix: catalog memory leak by @xiao-yu-wang in #20840
• feat: table level privilege by @xiao-yu-wang in #20841
• feat: table level privilege by @xiao-yu-wang in #20831
• chore: do not show red warnings by @zitsen in #20843
• fix: tglobal cus prompt support for windows by @sangshuduo in #20845
• fix: windows gettime negative value by @facetosea in #20800
• fix: select * from (select * from t order by ts desc) order by ts by @shenglian-zhou in #20838
• fix: install.sh check if connector/examples exist by @sangshuduo in #20849
• fix: handle leak by @facetosea in #20836
• feat: table level privilege by @xiao-yu-wang in #20852
• test: add new feature with previous cluster running case by @DuanKuanJun in #20822
• fix: install.sh check if connector/example exist by @sangshuduo in #20848
• test: change autogen.py random to fixed by @DuanKuanJun in #20802
• feat: table level privilege by @xiao-yu-wang in #20853
• enh: add queryMaxConcurrentTables configuration by @dapan1121 in #20850
• Update 14-stream.md by @54liuyao in #20856
• Update 14-stream.md by @54liuyao in #20810
• Update 06-stream.md by @54liuyao in #20855
• fix: table level privilege by @xiao-yu-wang in #20859
• feat: table level privilege by @xiao-yu-wang in #20860
• enh: stmt ignore get fields errors by @dapan1121 in #20858
• fix(udf): make strncat working for release building by @stephenkgu in #20854
• feat(query): INTERP support boolean type by @glzhao89 in #20844
• feature: udf replace function by @shenglian-zhou in #20781
• docs:compile error by @dingbo8128 in #20865
• fix:optimize log & change the length of tag if tag is null in schemaless by @wangmm0220 in #20857
• test: add udf function return with varchar demo by @DuanKuanJun in #20815
• fix(shell): update the double display. by @hjxilinx in #20864
• fix: script if share not exist by @sangshuduo in #20875
• merge main by @xiao-yu-wang in #20868
• fix(tsdb/cache): skip schema updating for non ts row by @stephenkgu in #20872
• fix(udf1): use 1 as luck number to make new gcc happy by @stephenkgu in #20870
• fix: show user privileges invalid write by @xiao-yu-wang in #20879
• merge main by @xiao-yu-wang in #20881
• enh: refactor some sync func names by @bgzhao66 in #20880
• Update 14-stream.md by @54liuyao in #20878
• fix(driver): return error code to java by @huolibo in #20869
• fix: taosdump continue if fail by @sangshuduo in #20886
• fix: taosdump continue if ts out of range for main by @sangshuduo in #20887
• add cancel in fetch cluster by @cadem in #20842
• docs: TD-23520 update english documents for schemaless by @danielclow in #20846
• fix: error querying after setting permissions for varchar type tags by @xiao-yu-wang in #20889
• docs: add rest api diff by @sangshuduo in #20892
• fix: the precision of delete statement by @kailixu in #20890
• docs: use html table in rest api by @sangshuduo in #20893
• docs: use json instead of table in rest api by @sangshuduo in #20895
• test: reopen tmqDelete-1ctb.py by @plum-lihui in #20894
• fix: fix max/min(tag) random result by @glzhao89 in #20863
• docs: fix connector case by @sangshuduo in #20900
• enh(taosAdapter): make the schemaless automatic database creation configurable by @huskar-t in #20903
• enh(taosAdapter): make the schemaless automatic database creation configurable by @huskar-t in #20902
• fix(tsdb/read): remove duplicate schema fetching by @stephenkgu in #20899
• fix(tsdb/cache): fix block index ref releasing by @stephenkgu in #20905
• chore: fix install.sh for explorer by @zitsen in #20917
• enh(docker): add debugging tools in TDengine image by @huskar-t in #20908
• Doc/xsren/install des on mac base main by @facetosea in #20910
• balance leader to enterprise by @cadem in #20906
• fix: fix illegal usage of _isfilled/_irowts by @glzhao89 in #20915
• enh(docker): add debugging tools in TDengine image by @huskar-t in #20909
• chore: fix packaging install.sh for explorer OEM by @zitsen in #20921
• merge 3.0 by @xiao-yu-wang in #20883
• chore: fix install.sh when not root by @zitsen in #20922
• enh: refactor some vars in syncLogReplProcessReplyAsNormal by @bgzhao66 in #20897
• test: add flush database in some testcases by @bgzhao66 in #20891
• fix(tsdb/read): release bi cache entry before returning by @stephenkgu in #20914
• fix: add three more stars for shell mask for main by @sangshuduo in #20916
• merge 3.0 by @xiao-yu-wang in #20923
• fix: optimizing 'alter table drop tag' error reporting by @xiao-yu-wang in #20926
• enh: try to propose vnode commit at vnode closing by @bgzhao66 in #20927
• fix: fix timestamp constant comparison precision error by @glzhao89 in #20885
• add option enableScience on taos.cfg to show float and double scientific notation by @DuanKuanJun in #20925
• enchance: increate testpackage.sh timeout seconds by @xleili in #20920
• fix:open test cases for tmq & add log if rebalance error by @wangmm0220 in #20882
• fix: an important fix by @hzcheng in #20941
• release: upgrade default version by @xleili in #20936

New Contributors

• @gechunlin made their first contribution in #19447

Full Changelog: ver-3.0.3.2...ver-3.0.4.0