Releases: taosdata/TDengine
Releases · taosdata/TDengine
3.4.1.6
Behavior change and compatibility
Enhancements
- When creating taosX tasks in taos-explorer, users are automatically redirected to the XNODE creation page if no XNODE is available
- In Explorer DataIn, the default empty tag column is automatically removed when a supertable data column is moved to the tag column
- Improved cross-origin security in taos-explorer
- Added an XNODE management page to taos-explorer
- Optimized communication logging between xnoded and taosX
- Improved SQLAlchemy compatibility in taos-ws-py
- Added support for importing and exporting taosX configuration files through taos-explorer
- Added automatic reconnection support for the AVEVA Historian data source in taosX after disconnection
- Added support in the Rust connector for subscribing to batch tag update messages
- Added DECIMAL and BLOB support to parameter binding in the Rust connector
- Added a connector security development guide and security examples
- Added the -H option to taos shell to display BINARY strings containing non-printable characters in hexadecimal format (0x...), disabled by default
- Added daylight saving time conversion support to the TO_ISO8601 function
- Added minute-level timezone offset support for the TZH format in the to_char and to_timestamp functions
- In STMT2 write mode, child-table metadata changes no longer return the TSDB_CODE_NEED_RETRY error
- Interval windows now support partitioning based on the timezone carried by the client
- Optimized the output format of show table distribute and added the INFORMATION_SCHEMA.INS_DISK_USAGE system table for querying table data distribution
- Optimized the truncation logic when the last WAL file is corrupted
- Tables used by subscriptions can now be dropped. After dropping and recreating the table, running reload topic restores the subscription
- Added the syncAssignedCheckAppliedGap parameter. In dual-replica mode, when a node is assigned as leader, this parameter controls the threshold gap between the follower's applied index and commit index to prevent the follower from entering the restoring state before catching up
- Added DECIMAL column support for virtual tables
Fixes
- Fixed slow loading of the Explorer DataIn tasks page when many tasks exist
- Fixed inaccurate SQL execution times returned by taos-explorer
- Fixed the issue where filter conditions did not take effect when configuring taosX tasks in taos-explorer
- Fixed backup point generation errors in taosX when no data is available
- Fixed an internal logic error that caused OPC access failures on Windows when taosX bound to port 6051
- Fixed the issue where the authentication parameter input box was not displayed when Custom Authentication was selected for the Pulsar data source in taosX
- Fixed the issue where the Pulsar data source in taosX remained in the creating state because data splitting is unsupported
- Fixed incorrect auto-increment behavior when taosX generated timestamp column data with composite primary keys for Kafka data sources
- Fixed the issue where taosX did not display an error and could not recover or retry when fetching sample data for SparkPlugB
- Fixed the intermittent failure to stop xnoded child processes on Windows
- Fixed the issue where taosdump returned empty data without throwing an exception when the engine service became unavailable during WebSocket reads
- Fixed significant performance degradation when taosdump exported large-volume subtables
- Fixed incorrect path handling when generating keys with the taosk tool
- Fixed the issue where the queryTableNotExistAsEmpty parameter did not take effect when accessed through taosAdapter
- Fixed errors when creating streams in nanosecond-precision databases if fixed values were used for TAG columns in stream output tables
- Fixed conflicts between expired data deletion (trim) and shared-storage migration operations
- Fixed a potential issue where the mnode message queue could become saturated during data compact operations if some nodes stayed offline for an extended period, causing connection exceptions
- Fixed failures when writing monitoring information to the log database
- Fixed a latent risk caused by inconsistent column counts between virtual subtables and virtual supertables in the schema
- Fixed crashes caused by executing certain functions in queries without a FROM clause
- Fixed crashes caused by type-conversion expressions such as not (cast(null as varbinary) between now() and ts) in queries
- Fixed errors when writing stream computing results to an existing regular table as the result table
- Fixed an OOM issue caused by incorrect memory release logic when using %%tbname in stream queries under large-write workloads
- Fixed high memory usage in count_window when reading historical data in stream computing
- Fixed OOM crashes caused by an uncontrolled upper limit on the number of sliding windows during WAL replay in stream computing
- Fixed crashes in outer stream queries when diff() and notify were used together
- Fixed crashes and incorrect results in the group_concat function
- Fixed inconsistencies between the execution plan and actual execution when CASE WHEN referenced the primary key as a filter condition
- Fixed a memory leak on taos_cleanup exit
- Made the output of USE DATABASE on macOS consistent with Linux; it now uniformly displays Database changed.
- Fixed the issue where the Windows installer could not shut down processes gracefully
What's Changed
- docs(c#): update TDengine.Connector version to 3.2.0 and add WebSocket failover support by @huskar-t in #34970
- docs: move main to new pkglist and release components by @danielclow in #35017
- fix: windows cases failed issues by @dapan1121 in #35014
- docs: update SQLAlchemy dependency requirements for taos-ws-py connector by @qevolg in #35009
- docs(taosgen): enhance CSV reader to support blob file pattern and streaming mode by @YamingPei in #34975
- fix: resolve many tdb bugs by @localvar in #35006
- docs(jdbc): publish 3.8.2 by @sheyanjie-qq in #35029
- docs: update release note for 3.4.1.0 in office web by @feici02 in #35039
- fix(query/mem): release msg memory immediately instead of response by @stephenkgu in #34988
- fix: fix crash in scalar caused by window function without from by @dapan1121 in #35043
- fix: update allure report URLs to remove port number by @tomchon in #35050
- enh: virtual table support decimal. by @Simon9997 in #35026
- fix(stream): tolerate existing output table on submit;fix stream out-column timestamp precision checks by @Pengrongkun in #35044
- docs: remove slugs and update links to md by @danielclow in #35053
- docs: update ha overview by @danielclow in #35018
- fix(planner): verify %%tbname to use single-table external window by @JinqingKuang in #35054
- fix:query return error unknown error 65535 issue by @dapan1121 in #35003
- fix: cast to json unknown 65535 error and add ut cases by @dapan1121 in #35073
- test(os): join threads to avoid race/use-after-free in osSemaphoreTests by @facetosea in #35055
- fix(taos-tools): remove custom duplicate macros and uniformly use the macro definitions under the project's include directory by @YamingPei in #35025
- fix(stmt2): correct DECIMAL in KV+blob row build and align bind path with parsed columns by @Pengrongkun in #35010
- fix: colDataKeepFirstNRows reset varmeta.length when all kept rows ar… by @facetosea in #35061
- fix(parser): relax stream tag type modifier checks for stream tags by @JinqingKuang in #35089
- docs(window): clarify tag usage in state and event windows by @JinqingKuang in #35091
- enh: timezone to conform iso8601 - main by @localvar in #35081
- fix(tmq): optimize poll logic & vtable meta error & dead lock in sometimes by @wangmm0220 in #35086
- fix: Improve the externalwindow documentation while fixing the bug in the group_concat function by @facetosea in #35078
- feat: Enhance TDgpt installer with resource package support by @tomchon in #35069
- fix:clean build directory in CI workflow for docs by @tomchon in #35100
- docs: update python docs by @qevolg in #35090
- fix(taosdump): cancel the page-based query of table data and switch to a single query instead by @YamingPei in #35096
- fix(client): tsQueryTbNotExistAsEmpty still exposes TABLE_NOT_EXIST to caller by @JinqingKuang in #35104
- doc: update user manual for anomaly detecion. by @hjxilinx in #35106
- fix(stream): force read all data for count window by @JinqingKuang in https...
3.4.1.0
Behavior change and compatibility
Features
- feat: mcp server for TDengine TSDB
- feat: support external window query with time range explicitly specified by subquery, suitable for complex analysis scenarios such as cross-event correlation, window reuse and hierarchical filtering
- feat: support uncorrelated scalar subquery
- feat: add support for the ANY/SOME/ALL/EXISTS/NOT EXISTS operators
- feat: support batch modification of child table tag values
- feat: stream adds support for scheduled calculation by natural week, month, quarter, and year dimensions
- feat: add the timeout notification function for stream when no new data is written to source child tables/virtual child tables
- feat: subscription function adds support for metadata changes of virtual tables
- feat: data subscription supports token-based login
- feat: add identity authentication functions
- enh: add support for CAST and SUBSTR functions on BLOB type
- feat: support the lag、lead、fill_forward function
- feat: the fill clause of interval and interp supports surround time range
- feat: support scalar subqueries without the FROM clause
- feat: support non-correlated subqueries in IN operator
- feat: taosd adds support for the data repair mode
- feat: TDgpt adds support for the multivariate anomaly detection feature
- feat: taosX add task owner privileges
- feat: taosX support system & object level privileges
- feat: taosX new data-in pSpace
- feat: OPC-UA connection test support failover
- feat: kafka transformer support filter to split messages to multiple schema
- feat: KingHistorian dataset auto update
- feat: KingHistorian support non-stop migration when end timestamp set empty
- feat: go websocket subscription support token auth
- feat: Go REST connector support TOKEN auth
- feat: rust subscription support token auth
- feat: c websocket subscription support token auth
- feat: taosdump now support decimal data type
- feat: taosdump now support BLOB data type
- feat: taosgen support windows
- feat: taosgen support setting log options in config file
- feat: taosKeeper add endpoint for exporting all metrics
- feat: Explorer support token response in login
- feat: explorer support totp auth
- feat: explorer support bearer token auth
- feat: support multitple brokers in MQTT task
Enhancements
- enh: taosX now works on Windows
- enh: add support for TDgpt functionality on the Windows platform
- enh: add support for stream functionality on the Windows platform
- enh: improve the query performance of aggregate queries with GROUP BY on virtual super tables
- enh: optimize the query performance of interval、session、event windows for virtual super tables
- enh: optimize query performance when virtual tables reference many columns of physical tables
- enh: optimize the query performance of state windows for virtual super tables
- enh: push down the time filter conditions of non-correlated subqueries to improve the batch query performance of virtual tables
- enh: return clear error information when virtual table creation fails, such as type matching failure of a specific column
- enh: add reference verification capabilities between virtual tables and source tables, including reference relationship storage, source table change verification, reference relationship query and virtual table availability verification functions
- enh: improve the performance of last_row queries
- enh: support dynamic adjustment of LRU shard count to improve the execution performance of Last queries
- enh: RESTORE DNODE command supports specifying VGROUP ID
- enh: Improve the subscription speed in the scenario of interlace writing
- enh: add support for the IN operator in subqueries of stream
- enh: add support for ANY/SOME/ALL/EXISTS/NOT EXISTS operators in stream
- enh: add support for subqueries in stream computing scenarios
- enh: add support for child table addition/deletion, child table tag value modification, and column mapping relationship adjustment to the trigger mechanism of virtual super tables in stream
- enh: stream supports multi-group batch computation
- enh: support batch deletion of stream computing
- enh: add NODELAY_CREATE_SUBTABLE option for stream to create result tables in advance when no data is written
- enh: Improve the performance when subqueries are used as primary key filter conditions
- enh: optimize the fill(prev/next/near/linear) filling syntax of the interp function to support filling with non-NULL values before/after the target position
- enh: join/window join supports operations based on selection function resultsets
- enh: display query execution progress for the SHOW QURIES statement
- enh: upgrade the explain analyze function, fix the deviation in operator execution time statistics, add various operator indicators, improve result readability
- enh: optimize the reporting logic of slow logs to improve the accuracy and timeliness of reporting
- enh: provide clearer error messages for SQL statements
- enh: correct comparison results of NULL values in the IN operator
- enh: add security protection capabilities against SQL injection
- enh: add protection capabilities against Denial of Service (DoS) attacks
- enh: add protection capabilities against overflow attacks
- enh: add the capability of forced overwriting after sensitive data deletion
- enh: add support for the configuration parameter AuditSaveInSelf; when enabled, audit information is recorded without going through taoskeeper
- enh: add support for the enableGrantLegacySyntax parameter; when set to 1, the authorization syntax of v3.4 is compatible with v3.3
- enh: remove the forceReadConfig parameter
- enh: optimize the timer logic after system time changes
- enh: when the password is incorrect in the subscription scenario, return the same "Authentication failure" error message as that of taos connection
- enh: support modifying the PASSWORD_LIFE_TIME, PASSWORD_REUSE_TIME, PASSWORD_REUSE_MAX, and ALLOW_TOKEN_NUM attributes of the ROOT user, and set the minimum password validity period to 1 day by default
- enh: add the configuration item enableAdvancedSecurity (default value is 0), which disables the password expiration, strong password and password rotation policy when set to 0(this behavior is consistent with v3.3)
- enh: prohibit connection between Community Edition and Enterprise Edition
- enh: TDgpt server uses Gunicorn instead of uWSGI as the service driver
- enh: taos shell supports logging in via token
- enh: taosdump add support for stmt2
- enh: auto review session in explorer
- enh: Explorer Licence page refinement
- enh: improve explorer ui for data-in tasks and transform
- feat: explorer can enable CAPTCHA on login
- enh: Explorer auto scale json parser input
- enh: Explorer activation input auto scale
- enh: C/Rust websocket connector security enhancement
- enh: JDBC doc recommend use varcharAsString=true for taos-ws
- enh: OPC custom tag support special chars replacing
- enh: taosX backup allow backup checkout when offset checking failed
Fixes
- fix: taosX breakpoint db lock race condition issue with multiple csv
- fix: kakfa data-in use full list json instead of json items
- fix: automatically trim spaces around sub table name in transform page
- fix: long parser error mislead root cause
- fix: OPCDA dataset collection possibly interrupt
- fix: XNODE replication task can't start
- fix: unable to select target database in tsdb import task dialog
- fix: opcda retrieves empty data points
- fix: TDinsight taosX panel task info error
- fix: task not restored in other xnodes when one stopped
- fix: taosX sync error with varbinary/blob datatype
- fix: SHOW XNODE TASKS should be ordered by id
- fix: vgroups information is not included when taosdump restores the database
- fix: the SQL statement content queried from the system table ins_streams is incomplete
- fix: "Invalid value in client" error is triggered when querying virtual super tables
- fix: the query reports a "Planner slot key not found" error when querying the timestamp and data column of a virtual child table if the data column does not reference the source table
- fix: unexpected task status for query migration tasks
- fix: the filter conditions for Agg aggregation results in stream do not take effect
- fix: taosd crashes when a virtual table executes an aggregation query with the partition by tag clause
- fix: query exception caused by inconsistent column types between virtual child table and mapped source table (usually due to adding or deleting columns with the same name)
- fix: crash when querying with parameter binding on virtual tables
- fix: the occasional crash issue when querying virtual super tables
- fix: stream computing sliding(0s) incorrectly returns success
- fix: potential crash when the SAMPLE function processes data exceeding the int32 range
- fix: the IF EXISTS option does not take effect when using DROP TSMA
- fix: no results returned when explain parses subqueries
- fix: stream fails to calculate historical data when using FILL_HISTORY
- fix: schema and tag synchronization issue when the stream result table already exists
- fix: taosd crashes when executing a Last query to read BLOB type data
- fix: taosc and taosd crashes when the trim function is called in an expression or function
- fix: data is still output when the result set of queries containing JOIN operations is empty in stream
- fix: query result is incorrect when a constant is used as the start time filter condition in a st...
3.4.0.9
Behavior change and compatibility
Features
- feat: taosAdapter add token support for subscription
- feat: taosdump support import/export virtual tables
Enhancements
- enh: massive ui enhancement for explorer
- enh: optimize the impact of frequent child table tag modifications on data writing when child tables of super table have subscriptions
- enh: table name template support expression
- enh: improve performance of virtual table queries with the tbname column
- enh: reduce log files to 3
- enh: adjust the maximum value of configuration parameter supportVnodes from 4096 to 1024
- fix: CREATE XNODE TASK error message refinement
Fixes
- fix: Kafka connection check log refinement
- fix: the GRANT ALL permission does not take effect when granted to a specific stream
- fix: the START/STOP STREAM permission does not take effect after being granted
- fix: failed to drop stream when having the DROP STREAM permission
- fix: taosd crashes when querying a view without permission
- fix: the ALTER VIEW permission does not take effect after being granted
- fix: auditor fails to view the complete user information
- fix: stream crashes when reading the timestamp of a table with a varchar-type composite primary key
- fix: failed to drop role using the IF EXISTS syntax
- fix: the error message is unclear when permissions are missing
- fix: port occupancy keeps increasing on macOS when calling the taos_query method of the native connection
- fix: in stream subquery, JOIN statements falsely report the error of missing timestamp primary key when using time placeholders such as _twstart as the first column of query results
- fix: timestamp columns in query results are incorrectly set when stream subquery contain interval windows
- fix: audit database creation operations fails to return when the data encryption key is not set
- fix: ordinary users lack write permission without explicit authorization after creating ordinary tables
- fix: modify the names of newly added encryption functions to keywords to resolve the issue of keywords being incorrectly written as actual content into the database during data writing
- fix: timetruncate function occasionally returns no results
- fix: unexpected error log when create xnode
- fix: expand parser length to 48k in taosX
- fix: no response in explorer tmq connection check
- fix: str len calculation error cause create clause error with invalid raw data len
- fix: create task via agent error
- fix: Explorer alert syntax error when switching tag to share topics
- fix: xnode task stuck at created status
- fix: Grid auto scalable in Explorer
- fix: reading tinyint(1)/boolean type for mysql
- fix: memory leak caused by unreleased auto table creation requests during STMT data writing
- fix: explorer backup task create error
- fix: opcplc special point id cause data points list error
- fix: data in tasks api respond as empty after created successfully
- fix: Explorer batch operation api error
- fix: build task update sql error in explorer
- fix: fast-xml-parser CVE-2026-25896
- fix: xnoded role time check error cause exit unexpectedly
- fix: the merge logic processes data incorrectly when stream handles out-of-order data of trigger tables with primary keys
- fix: client crashes when querying decimal data type using stmt
- fix: the scan interval is judged incorrectly when sliding < interval during stream sliding trigger
- fix: during the stream trigger phase, when pending calculation requests are accumulated, max_delay triggering resets the waiting time, resulting in the calculation not being triggered for a long time
- fix: taosX compatible with 3.4.x information_schema query result changes
- fix: invalid user login cause adapter memory increase
What's Changed
- fix: group_concat type error by @dapan1121 in #34443
- fix: remove asan and split cases by @dapan1121 in #34456
- fix: assign ownerId for normal table during test_priv_basic.py refactoring by @kailixu in #34459
- fix: set main to new-framework-test.yml by @tomchon in #34470
- feat(taosdump): taosdump supports dumping in/out virtual table by @YamingPei in #34431
- chore(keeper): add license and security check by @qevolg in #34454
- enh(tmq): optimize update tablelist for topic of stable with filter when alter tag by @wangmm0220 in #34417
- docs: update release note for 3.4.0.2 in office web by @feici02 in #34461
- [6755488313]: add-check-key by @cadem in #34464
- docs: auto detect version by @danielclow in #34467
- fix: execute taos shell timeout 10->120s by @DuanKuanJun in #34466
- fix: mergeAlignedInterval pkts error by @Tony2h in #34473
- opti(tmq): update tablelist if alter tag in tmq by @wangmm0220 in #34483
- enh(test): robustness for ut case tfs_test.cpp by @kailixu in #34484
- enh(test): robustness for ut case tfs_test.cpp by @kailixu in #34485
- fix: [6769589569] test-show-vgroups-fail by @cadem in #34486
- merge: from 3.3.6 to 3.3.8 by @wangmm0220 in #34477
- docs(jdbc): release 3.8.1 and update demo by @sheyanjie-qq in #34433
- fix(xnode): increase the length of parser column and config column by @acerDebugman in #34491
- refactor(build): use conan to handle dependencies and vulnerability check by @zitsen in #34489
- fix(tmq): cases error if split vnode not completed by @wangmm0220 in #34487
- fix: parse error while use NUL without quote. by @xiao-77 in #34474
- check shell case description by @minhuinie in #33399
- fix: ci case results depend on sorting, with probability of error by @facetosea in #34496
- Update container_build.sh by @tomchon in #34500
- chore: remove avro/jansson/zlib/snappy source code by @zitsen in #34501
- fix: stream primary key issue by @JinqingKuang in #34493
- enh: [6747163479] Ts cond push down in virtual table query by @Simon9997 in #34455
- fix: timetruncate results are abnormal when offset by natural month by @facetosea in #34442
- Fix/time truncate3.6 by @facetosea in #34463
- fix(xnoded): fix error msg when creating xnode by @acerDebugman in #34503
- merge: from 3.3.6 to 3.3.8 by @guanshengliang in #34505
- fix 3.3.8 to main conflict by @Simon9997 in #34510
- enh: use default taospy for tdgpt by @jiajingbin in #34502
- Test/maim/storage encrypt by @xiao-77 in #34426
- fix: cases cases/11-Functions/01-Scalar/test_scalar_crypto.py failed. by @xiao-77 in #34508
- fix: update workflow reference and improve return value checks in CI scripts by @tomchon in #34478
- fix(rbac): refactor docs, permission error, db owner and audit table[manual-only] by @kailixu in #34498
- fix:return void by @Pengrongkun in #34507
- fix: test_sql_length_boundary by @Pengrongkun in #34511
- fix: set max value of supportVnodes from 4096 to 1024. by @xiao-77 in #34497
- fix(stream): core dump in the interface of getting last ts if there is a varchar in primary key by @wangmm0220 in #34499
- docs: add database compact parameter descriptions by @danielclow in #34515
- fix(taos): semphore is not destroy by @wangmm0220 in #34492
- merge/3.3.8tomain by @wangmm0220 in #34494
- feat(service): add OOMScoreAdjust to taosd.service for better memory management by @tomchon in #34517
- fix(tests): comment out specific test cases in cases.task by @tomchon in #34518
- fix(build): remove backup of cargo config in container build script by @tomchon in #34522
- fix: ensure OOMScoreAdjust is set for taosd service by @tomchon in #34526
- fix(rbac): catalog sub task and view/stream privileges[manual-only] by @kailixu in #34506
- fix(tmqtt/producer): fix topic producer retvals by @stephenkgu in #34525
- fix(tmqtt/logging): fix retval checkings by @stephenkgu in #34530
- fix: docs ...
3.4.0.2
Behavior change and compatibility
Features
- feat: Automatically create xnode during TSDB initialization
- feat: Explorer License page show machine code
- feat: taosX-agent support xnode ha
- feat: taosX support parquet files import
- feat: add SQL recording for STMT in adapter
- feat: Rust native connector support STMT2
- feat: support dual conditions of duration and row count for true_for judgment in event and state windows of stream and batch query
Enhancements
- enh: STMT query supports the binding of the interval parameter
- enh: provide clearer error messages for SQL statements
- enh: add column created_by/labels for XNODE TASK
- enh: optimize the login verification logic to force root users who log in with the default password to change their passwords
- enh: improve the processing mechanism of data encryption for bse and other files
- enh: add notification mechanism related to user tokens
- enh: support upgrading clusters with old-version data encryption mechanism to new-version one
- enh: support creating TOTP secrets using the create totp_secret syntax
- enh: Support both IPv4 & IPv6 protocol stacks
- enh: support updating expiration time and policy for data encryption keys
- enh: allow any chars in MQTT topic
- enh: rename lag function to fill_forward and redevelop Lag function compatible with MySQL in follow-up
- enh: improve performance of cols + last queries on virtual tables with only one original table
- enh: support modifying permission control for users
- enh: improve permission control for views and audits
- enh: handle permission compatibility from version 3.3 to 3.4
- enh: prohibit users from tampering with configuration files after data encryption takes effect
- enh: optimize the notification content of stream period triggers by adding the trigger start time and end time fields (retaining the windowStart and windowEnd field names)
- enh: adjust the upper limit of the original tables referenced by virtual tables from 1000 to 2000
- enh: reduce the computing latency when stream query statements contain virtual table tag filter conditions
- enh: optimize the syntax of stream statements to support the use of placeholders such as _twstart in the ORDER BY clause
- enh: optimize the execution logic of outer join queries to resolve the issue where limit does not take effect when order by is not specified
Fixes
- fix: incorrect results when executing the show create table statement on virtual tables
- fix: null pointer error when InfluxDB schema changes
- fix: crash in stream caused by improper handling of heartbeat messages after mnode leader switchover
- fix: memory leak that occurs when UDF function initialization fails
- fix: influxdb error with backslash syntax in taosX
- fix: incorrect results when invoking the concat function in stream
- fix: taoskeeper allow special chars in password
- fix: inaccurate scheduled execution time for multi-level storage migration tasks
- fix: migrate stuck in AVEVA Historian data-in
- fix: incorrect results when the data in individual group windows is all NULL values during multi-group processing in state windows
- fix: abnormal calculation results after deleting and rebuilding the result subtable of stream
- fix: the client may crash when the concurrent write volume of STMT is high
- fix: incorrect default time configuration issue for password reuse restrictions
- fix: error while performing JOIN operations with subqueries without the FROM clause
- fix: MySQL DataIn task may blocking when few data rows
- fix: remove duplicate error details
- fix: trigger logic error of the true_for option in stream when out-of-order data is written
- fix: taosX native connection tmq error message
- fix: possibly stuck on systemctl stop taosd caused by xnoded
- fix: subscriptions created by a user cannot be canceled after the user is deleted
- fix: crash while combined use of group_concat function and count_window
- fix: fix create task error for opc
- fix: failed to set user permissions in taosExplorer of v3.4.0 version
What's Changed
- docs: update xnode port by @zitsen in #34152
- docs: update release note for 3.4.0.0 in office web by @feici02 in #34153
- docs: minor corrections by @danielclow in #34159
- feat(docs): add taosx datain Pulsar/Pulsar-Tuya docs by @acerDebugman in #34161
- enh: privilege parse and check create stream by @kailixu in #34143
- chore(jdbc): update jdbc version by @sheyanjie-qq in #34157
- fix(udf): destory data block in the error case by @stephenkgu in #34140
- fix(stream): add resetting tagScan logic & fix parse value error if value is integer & fix tmqError.py by @wangmm0220 in #34124
- feat: support create/drop totp_secret statement by @localvar in #34162
- enh: update keyword list by @localvar in #34177
- fix: groupagg with slimit by @facetosea in #34083
- docs: add connector compatibility desc by @sheyanjie-qq in #34181
- docs: remove tools and old downloads by @danielclow in #33927
- fix: enhance memory leak detection by adding ignore patterns and refactoring count functions by @tomchon in #34176
- Merge stream performance scene test script by @DuanKuanJun in #34139
- fix:add 3.3.8 ci test by @tomchon in #34189
- docs: update 2026 roadmap by @guanshengliang in #34194
- merge: from 3.3.6 to 3.3.8 by @guanshengliang in #34186
- fix: update branch references to 3.3.8 in workflow files by @tomchon in #34192
- fix: 6574866934 by @Pengrongkun in #34171
- fix:insert into stb subquery cross dnodes by @Pengrongkun in #34131
- merge: from 3.3.8 to main branch by @guanshengliang in #34196
- fix(udf): no decoding with error rsp by @stephenkgu in #34180
- fix: failed to run test_write_insert_select.py by @guanshengliang in #34211
- fix: no from query subplan type error by @dapan1121 in #34199
- docs: format udf doc by @danielclow in #34210
- fix:clientHbReq deserialize problem by @Pengrongkun in #34198
- fix: explain with no aggregate function window crash issue by @dapan1121 in #34201
- feat:stmt2 query free result by adapter by @Pengrongkun in #34155
- enh:stmt2 query free result by adapter by @Pengrongkun in #34214
- feat:stmt2 query free result by adapter by @Pengrongkun in #34200
- fix: correct syntax for checking existence of docs-c-test log file by @tomchon in #34191
- docs(log): modify doc of monitor by @wangmm0220 in #34213
- fix(client): heartbeat msg incompatible by @wangmm0220 in #34207
- fix(client): heartbeat msg incompatible by @wangmm0220 in #34208
- fix(client): fix the logic of reading slow log file if thers are \0\0 or other datas format in slow log file by @wangmm0220 in #34206
- Fix:client hb core by @Pengrongkun in #34221
- fix: wrong default value for password reuse time by @localvar in #34212
- feat: add option to force change default password by @localvar in #34165
- fix(stream/fetch): fix stream data fetching from runner by @stephenkgu in #34178
- fix(stream/fetch): fix stream data fetching from runner by @stephenkgu in #34170
- merge: from 3.3.6 to 3.3.8 by @guanshengliang in #34222
- fix: 3 bugs related to token and user by @localvar in #34219
- merge: from 3.3.8 to main by @guanshengliang in #34225
- fix: big offset error by @facetosea in #34183
- feat: add generate encrypt key at test framework. by @xiao-77 in #34182
- fix: allow_datetime cannot be set during create user by @localvar in #34226
- merge: from 3.3.6 to 3.3.8 branch by @guanshengliang in #34231
- enh(meta entry cache): cache switch and size control by @stephenkgu in #34014
- fix(query): init the stt block reader when returning the clean stt/da… by @hjxilinx in #34076
- case: submit test_user_security.py by @DuanKuanJun in https://github.com/taosdata/TDengine/pull...
3.4.0.0
Behavior change and compatibility
Features
- feat: adapter add connector info attribute in ws connection
- feat: C websocket support ssl/tls connection params
- feat: support taosAdapter instances register and query
- feat: parse and write any JSON data to database
- feat: add rust connector benchmark tool
- feat: support taosX high-availability and Kafka task load balancing
- feat: TDgpt supports row correlation analysis functions such as dtw, dtw_path and tlcc
- feat: data transmission supports SASL mechanism and resource control [Enterprise Edition]
- feat: data storage supports full transparent encryption [Enterprise Edition]
- feat: support multi-factor authentication (MFA) and multiple login security policies [Enterprise Edition]
- feat: support RBAC-based permission architecture [Enterprise Edition]
- feat: support hierarchical auditing and permission control [Enterprise Edition]
- feat: Support SM4_ENCRYPT, SM4_DECRYPT, AES_ENCRYPT, AES_DECRYPT, MD5, SHA, SHA1, SHA2, MASK_FULL, MASK_PARTIAL, MASK_NONE, FROM_BASE64 and TO_BASE64 functions
- feat: event window triggering of stream supports sub-event windows
- feat: Explorer add support for OAuth 2.0 and OIDC SSO
- feat: taosAdapter support customized SQL rejection rules
- feat: add identity authentication functions
Enhancements
- enh: increase the maximum number of columns supported by virtual tables to 32767
- enh: prohibit sorting by aggregate functions in non-aggregate queries
- enh: state windows now support specifying a "zero state" via zeroth_state, skipping computation and output for windows in this state.
- enh: optimize the error message when taosc initialization fails due to insufficient write permissions for the log file directory
- enh: stream now supports interp and percentile functions
- enh: reduce resource consumption of trigger data and computation data reading in stream computing
- enh: prohibit the use of duplicate timestamps in state_window, count_window and event_window on super tables
- enh: improved the exit handling logic of taosmqtt to achieve a more graceful shutdown and resource release
- enh: set the global timezone to reduce lock contention related to time conversion during concurrent queries and writes
- enh: window query do not require mandatory aggregate functions, support including only pseudo-columns like _wstart and tbname
- enh: Linux tar package supports non-root installation of TDengine TSDB with custom install path
- enh: after modifying tag columns, support data subscription to take effect without reconstruction by executing the RELOAD TOPIC command
- enh: support recording operations such as query and deletion in audit logs
- enh: add the client version number field to the show connections command.
- enh: add status and note fields to the ins_anodes_full table for real-time feedback on model and algorithm status
- enh: add two Hints parameters (WIN_OPTIMIZE_BATCH and WIN_OPTIMIZE_SINGLE) to improve the state window query performance of virtual tables
- enh: support encryption algorithm management [Enterprise Edition]
- enh: add clock check mechanism for communication between clusters
- enh: add support for virtual table queries in stmt2
- enh: compact command now support the force option
- enh: improve the query performance of aggregate and selection functions for virtual super tables
- enh: support for user login failure policies
- enh: optimize OPC-DA collection and auto-reconnection
- enh: execution plan supports displaying tag indexes
- enh: add the 'is_ready' column to the show vgroups command
- enh: add bool type validation during stmt2 writing
- enh: adjust the logs of stmt2 to facilitate problem troubleshooting
- enh: event window of stream generates window opening notifications only when the true_for condition is met
- enh: optimize the usage logic of read-write locks in RPC communication
- enh: return immediately when updating sub-table tags if the tag value remains unchanged, avoiding frequent updates to the sub-table set of data subscriptions
Fixes
- fix: the latest WAL version number was not used when stream triggered data recalculation, resulting in incorrect calculation results
- fix: query error when col in order by abs(col) exists in result set instead of table
- fix: the results of show create table and SELECT distinct tbname, json_tag_name are not as expected when the TAG column is of JSON type
- fix: when parsing the output table tag name in the stream creation statement, the backtick (`) was mistakenly taken as part of the column name, which did not match the column name of the table created manually via SQL, resulting in the "Ou
- fix: resolve incorrect query results when subqueries in nested queries use descending sorting, no sorting, or sorting by non-time primary key
- tix: concurrency issue caused by modifying tdb while data subscription is in progress
- fix: OPCUA download data points not work when edit
- fix: support import alert dashboard for Grafana 12.x
- fix: the cache_load field of ins_vgroups is displayed as a negative value when it exceeds the maximum value of int32
- fix: potential crash risks during query memory control
- fix: stream fails to calculate historical data when using FILL_HISTORY
- fx: stream errors when reading data cause subsequent computing tasks to wait
- fix: no longer require sorting when the time primary key of sub-tables in JOIN syntax is a constant
- fix: Kafka extract/split with depth error
- fix: schema and tag synchronization issue when the stream result table already exists
- fix: resolve the issue of failed rawdata data subscription
- fix: Explorer upload monitor to taoskeeper by default
- fix: crash caused by excessively long table names during STMT2 automatic table creation on write
- fix: "Invalid value in client" error is triggered when querying virtual super tables
- fix: KingHistorian subscription not work
- fix: incorrect tbname processing logic when writing data via the insert into stable syntax
- fix: the issue of probabilistic failure when stream sends event notifications via WebSocket
- fix: taosX req_id can't find in other components
- fix: node.js support no timezone on window
- fix: Explorer login error without subpath
- fix: transactions cannot end when modifying global variables
- fix: fix latency issue in opc-ua
- fix: logic error caused by columns of multiple virtual tables using the same original table column
- fix: taosAdapter crash caused by callback function not being called after stmt query returns
- fix: taosX my cause sql too long with 100k message per row
- fix: data is written to an incorrect dnode and triggers the "Vnode is closed" error when executing insert into select statements
- fix: coredump occurs when the join query in stream subquery contains the tag==%%n condition
- fix: unexpected split result in transform
- fix: field_type error in c ws taos_stmt2_get_fields
- fix: incorrect data source was invoked when using anomaly detection in stream
- fix: the issue that query processes get stuck when both dbname and tbname are set to
?in query statements executed via stmt2 - fix: InfluxDB no tag measurements data in error
- fix: errors occurring when modifying the internal table structure concurrently during schemaless writing
- fix: incorrect results when querying with state window and partition by
- fix: errors in the outer cols function of nested queries
- fix: AVEVA Historian data in configration error
- fix: resolve the crash issue when querying virtual tables that reference data columns of the same name but different types in sub-tables
- fix: abnormal data loading issue when upgrading from version 3.3.6.32-3.3.6.36 to 3.3.8.6-3.3.8.10
- fix: crash occurs occasionally during disk flushing for decimal-type data with NULL values when caching is enabled
- fix: client cannot perceive table schema modifications made by other clients
- fix: PI/PI-Backfill ingestion error with period sign
- fix: fix not found model in dsn error while creating pi tasks
- fix: fix taosgen coredump in case of inccorect csv format
- fix: crash occurs when stream triggers table creation without carrying written data
What's Changed
- merge: from main to 3. 0 branch by @guanshengliang in #33174
- merge: from main to 3.0 branch by @guanshengliang in #33202
- enh: add stream log by @facetosea in #33201
- Case verify stream bugs on branch 3.0 by @DuanKuanJun in #33193
- fix: test case by @facetosea in #33221
- enh: support interp and percentile functions in stream by @dapan1121 in #33150
- fix: stream interp and percentile description by @dapan1121 in #33237
- merge: from main to 3.0 branch by @guanshengliang in #33254
- enh: Code Optimization by @facetosea in #33283
- fix(stream): reset tableScan operator by @wangmm0220 in #33225
- feat: support zeroth state in state window by @Tony2h in #33294
- fix: check dnodes status until ready by @SallyHuo-TAOS in #33366
- enh: rename windows ci cases files name by @tomchon in #33368
- fix(stream): tsdb reader reset error by @wangmm0220 in https://github.com...
3.3.8.8
Behavior change and compatibility
Features
- feat: taosX add KingHistorian data-in
- feat: taosX add new datasource: pulsar & tuya
Enhancements
- enh: active-active support enable WAL marker to lock WAL
- enh: C WebSocket connector performance optimized
- enh: improve startup speed of stream with historical data
- enh: support caching filter results of tag equality conditions in stream
- enh: c/rust websocket connection support conn_timeout
- enh: clarified error messages for white noise check failures in the data completion algorithm
- enh: enhanced error messages for unresolvable or unreachable hostnames to indicate the root cause more clearly
- enh: TDgpt's imputation function supports arbitrary sampling intervals
- enh: taosX data migration supports conn_timeout
- enh: Add debug commands like vi, ps, etc. to Docker
- enh: improve corner case memory usage to avoid oom
- enh: taosX improve mem usage and speedup for flat stream
- enh: Explorer extracted columns can be extracted in chain
- enh: add maxSQLLength to set the maximum length of SQL statements
- enh: Rust websocket connection support read timeout
- enh: taosX archive file size and count limit
- enh: simplified the retry logic in the query process, and uniformly used maxRetryWaitTimes to control the maximum retry time
- enh: remove info log for points in opcda
- enh: OpenTSDB data-in support customized table name
- enh: speedup perf when table not exist for tmq to td
- enh: taosX import csv in batches
- enh: improve recovery speed after restart in clusters with multiple vnodes requiring data synchronization
- enh: allow TMQ subscription to TSDB v3.1.x
- enh: taosX support migration with additional WHERE condition
- enh: taosX support reclaim memory by interval or sighup
Fixes
- fix: event window of stream does not create output table when no data output.
- fix: taosX data synchronization included extra non-qualifying table structures.
- fix: fix a mem-leak issue of taosBenchmark
- fix: stream trigger incorrectly handles NULL values during DELETE-triggered recalculation
- fix: historical data triggering of stream state window does not support the extend parameter
- fix: stream compatibility issues when upgrading from version 3.3.7 to 3.3.8
- fix: incorrect calculation result of the state window when the data block boundary is a null value
- fix: incorrect window splitting in RSMA function when the timestamp is negative
- fix: leader switchover failure of dual-replica mnode.
- fix: election during snapshot transmission in the synchronization module causes a deadlock
- fix: stream sliding windows for virtual super tables lacked sub-table names in message notifications
- fix: resolve the issue where virtual super tables do not support SELECT DISTINCT TAGS queries
- fix: resolve the issue where a UNION query returns incorrect results if one of its subqueries contains only constant conditions in the WHERE clause
- fix: memory leak when MQTT subscription exits
- fix: resolve the memory leak issue when referencing virtual tables in stream
- fix: resolve the issue where virtual super tables do not support SELECT COUNT(1) queries
- fix: resolve the issue where the DERIVATIVE function returns an extra row in the result set when the query includes the tbname column
- fix: Resolved Docker image upgrade start-up failure after changing the taosd password, affecting versions 3.3.8.0–3.3.8.4
- fix: virtual table stream does not trigger computing as expected
- fix: time resolution processing error in TDgpt's Prophet algorithm model
- fix: query result error when the state window's extend value is 1 and the end of the window is all empty data
- fix: explorer input eroro when extract or filter preview
- fix: taosX fix mem increase and panic in archive in case of taosd errors
- fix: fix schema only backup restore error
- fix: crash caused by memory cleanup when sync message sending fails
- fix: TSDB Lite Explorer loading is slow
- fix: fix description attribute error in some special OPC-UA servers
- fix: multiple selections of namespaces cause error
- fix: fix unexpected taosX filtered metrics
- fix: query does not return the correct error code when it is killed
- fix: precision error in decimal constant conversion
- fix: stream cannot restart after adding new column mappings to the virtual table
- fix: failed to restore vnode when there are a large number of null values
- fix: resolved issue where virtual table queries failed after adding or removing Schema in their corresponding sub-tables.
- fix: time precision error in the last_compact column of the ins_filesets system table
- fix: stream repeatedly reports window opening events after restart
- fix: upgrade arrow dependencies for jdk21
- fix: reduce OpenTSDB log file size for taosX
- fix: InfluxDB data source table name inconsistent with disorder tags
- fix: error writing BLOB data type via super table auto-creation statements
What's Changed
- enh(stream): merge from main by @wangmm0220 in #33284
- enh(test): insert data in parallel by @kailixu in #33429
- test: support multi vm run CI by @SallyHuo-TAOS in #33436
- fix(docker): remove openjdk-17-jre-headless entry from Dockerfile.base by @tomchon in #33445
- Enh/stream/only createtable supported main2 by @facetosea in #33420
- fix explore-sys metric's sub table name by @sheyanjie-qq in #33441
- fix: Fix Docker command port mapping in documentation by @tomchon in #33449
- docs: update release note for 3.3.8.4 in office web by @feici02 in #33456
- enh/TD-38474-modify-sdb-data by @cadem in #33457
- ci: update branch configuration for taoskeeper build workflow by @qevolg in #33443
- feat(csv): docs update #TS-7450 by @zyyang90 in #33461
- enh: use TAOS_FQDN to start taosd by @tomchon in #33462
- feat: optimize the usage instructions of taosdump by @YamingPei in #33460
- enh: Remove macOS 13 from build matrix because of image Deprecated by @tomchon in #33466
- avoid cpu occupied by @yihaoDeng in #33465
- Fix/TS-7588 by @yihaoDeng in #33468
- merge: from 3.3.6 to main branch by @guanshengliang in #33474
- feat(taos): add connector info for perf_connections by @wangmm0220 in #33458
- fix: state window handle all-null datablock error by @Tony2h in #33439
- fix/TD-38490-reset-heartbeat-after-mnode-leader-restart by @cadem in #33473
- fix(rsma): window split for negative ts by @kailixu in #33467
- feat: write results of the super table query to a json file by @YamingPei in #33470
- case: tidy up cases (10.31) Migrate system-test by @DuanKuanJun in #33444
- merge: from 3.3.6 to main branch by @guanshengliang in #33486
- docs: update network by @guanshengliang in #33488
- fix[TD-38515]: fix ci return value check issue by @localvar in #33489
- docs: add window interval description by @dapan1121 in #33493
- fix/TS-7542-double-free by @cadem in #33494
- docs: update network by @guanshengliang in #33492
- feat:auth server by @Pengrongkun in #33469
- fix/TD-38495-snapshot-start-receiver-writer-error by @cadem in #33477
- merge: from 3.3.6 to main branch by @guanshengliang in #33503
- refactor(query): refactor failed task retry control procedure. by @hjxilinx in #33498
- refactor(query): refactor query task redirect process. by @hjxilinx in #33502
- merge: from 3.3.6 to main branch by @guanshengliang in #33504
- docs: update the Python documentation and upgrade taos-ws-py by @qevolg in #33496
- test: enhance the debugging information and exception handlingcapabilities by @YamingPei in #33497
- fix:stmt2 ut by @Pengrongkun in #33505
- Enh/add stream latency marks by @wangmm0220 in #33518
- Enh/add stream latency marks by @wangmm0220 in #33527
- fix: possible snapshot message size error and log info by @hzcheng in #33526
- Fix/336/csv-parse-error by @xiao-77 in #33500
- fix: possible snapshot message size error and log info by @hzcheng in #33525
- Enh/add stream latency marks by @wangmm0220 in https://github.com...
3.3.8.4
Behavior change and compatibility
Features
- feat: taosX support OPC failover endpoint
Enhancements
- enh: taosX allow sync from higher precision to lower eg. ns to ms
- enh: Adapter support connection management and request limit
- enh: improve performance for last_row + composite queries
- enh: taosws taos_stmt_num_params support selects
- enh: improve log and error code display during mnode startup
- enh: refine document for error codes
- enh: reduced CPU usage for stream when reading data
- enh: speedup small queries in C/Rust websocket connection
- enh: REST API response will use null for nan/inf instead of error
- enh: no longer retry timed-out RPC messages
- enh: improve performance for last_row + tags queries
- enh: Improved query performance for virtual super tables
- enh: Explorer Grid canvas suppot plotting with DECIMAL
- enh: OpenTSDB data-in support timestamp/value field rename
- enh: unify login-register process in enterprise & community
- enh: add configuration parameter rpcRecvLogThreshold to set the threshold for warning logs in the rpc module
- en: Explorer Dashboard node table now is sortable
Fixes
- fix: tmq_get_json_meta behaves unexpectedly when the tags of subscribed meta messages contain empty strings.
- fix: decode overflow interior page returns wrong pgno
- fix: free() invalid pointer in taos-connector-rust
- fix: the retention task does not exit when drop and recreate database with the same name while RSMA exists
- fix: clearing user_ip in taos_options_connection does not take effect
- fix: slow leader election when a single node in a dual-replica setup loses network connectivity
- fix: crash occurred when querying a virtual supertable without including the timestamp primary key
- fix: fixed the rare issue of inconsistent config parameter values across dnodes after modifying dnode parameters.
- fix: incorrect result issue when the stream statement contains tag=%%1.
- fix: state window fails to properly handle data with NULL states
- fix: crash when concurrent writes and last queries are performed simultaneously.
- fix: new values cannot be immediately queried after updating server configuration parameters
- fix: fix C WebSocket stmt2 automatic reconnection
- fix: subscription failure when the WAL version number exceeds the maximum value of int32
- fix: startup failure on CPUs with 200 cores or more
- fix: explorer query NaN as null
- fix: show create table command execute error when the tag value is an empty string
- fix: crash caused by memory cleanup when sync message sending fails
- fix: incorrect _wduration result in time window queries with sliding.
- fix: invalid sttblockreader initialization actions in window queries.
- fix: resolved incorrect end_point information in perf_connections
What's Changed
- enh: optimize stable event window plan by @dapan1121 in #33195
- fix: TD-38212 by @cadem in #33186
- docs: update release note for 3.3.8.1 in office web by @feici02 in #33216
- fix: type conversion error by @menshibin in #32844
- feat: complete version number character copying by @menshibin in #33206
- docs: update python ws version history by @qevolg in #33222
- fix: fix tdgpt timemoe model directory by @SallyHuo-TAOS in #33213
- enh(last): enable reading cache when select last and tags by @Tony2h in #33204
- enh: TD-38163-mnode-open-log by @guanshengliang in #33160
- fix: clearing user_ip in taos_options_connection does not take effect by @yihaoDeng in #33229
- fix: clearing user_ip in taos_options_connection does not take effect by @yihaoDeng in #33228
- enh: rsma docs and task monitor by @kailixu in #33219
- fix: TS-7219-handle-status-req-timeout by @cadem in #33210
- merge: from 3.3.6 to main branch by @guanshengliang in #33235
- fix: get stream tasks list crash issue by @dapan1121 in #33238
- feat: unique getBuildPath invoke and ignore .git branch name contain … by @SallyHuo-TAOS in #33233
- enh: TD-38278-print-error-code by @cadem in #33231
- enh(last): enable using cache when select last and composite key by @Tony2h in #33234
- Fix/test case/err desc main by @facetosea in #33246
- enh: add and apply trigger latency config by @dapan1121 in #33245
- fix(stream): fix memory leak in vtable data merge by @JinqingKuang in #33194
- enh(last): enable reading cache when select last and tags by @Tony2h in #33236
- Docs for error codes Prefix Categories by @DuanKuanJun in #33250
- merge: from 3.3.6 to main by @guanshengliang in #33255
- fix: TD-37490 ci case by @facetosea in #33187
- docs: update conntector and error code page, remove rest connect type by @sheyanjie-qq in #33266
- fix: add thread create debug log by @dapan1121 in #33262
- Wrapper Library Add Hint Message by @DuanKuanJun in #33257
- fix(stream): fix trigger waking for available runner by @JinqingKuang in #33264
- docs: update c native stmt2 example by @qevolg in #33272
- fix[TD-38121]: fix two tdb bugs for 3.3.6 by @localvar in #33274
- fix[TD-38121]: fix two tdb bugs by @localvar in #33260
- enh(stream): reset table scan in reader by @wangmm0220 in #33247
- alter cron time by @happyguoxy in #33286
- fix(tref): increase TSDB_REF_OBJECTS from 100 to 2000 for improved reference handling by @yihaoDeng in #33281
- fix(tref): increase TSDB_REF_OBJECTS from 100 to 2000 for improved reference handling by @yihaoDeng in #33282
- feat: add rpcRecvLogThreshold configuration for logging threshold by @yihaoDeng in #33277
- feat: add rpcRecvLogThreshold configuration for logging threshold by @yihaoDeng in #33241
- fix: memleak by @facetosea in #33280
- fix: adjust rocksdb log by @yihaoDeng in #33013
- enh: optimize vtable scan by @Simon9997 in #33232
- enh: Wrapper Library Add Hint Message(3.3.6 branch) by @DuanKuanJun in #33270
- docs: add libtaosws.so and libtaosnative.so load failed resolution by @DuanKuanJun in #33276
- docs: jdbc release 3.7.6 by @sheyanjie-qq in #33293
- merge: from 3.3.6 to main branch by @guanshengliang in #33290
- docs: update roadmap by @guanshengliang in #33307
- tidy up CI case for link function by @DuanKuanJun in #33253
- Update to the nvl2 function description by @liuyq-617 in #33314
- fix(stream): tsdbReader is null by @wangmm0220 in #33306
- enh: Modify maximum TSMA num from 3 to 10. by @Simon9997 in #33145
- fix(stream): cases error in sometimes by @wangmm0220 in #33243
- enh: optimize log in vnodeQuery.c for better debug info by @hzcheng in #33267
- Fix/fixMemleak336 by @yihaoDeng in #33261
- enh: Add error logging when scan meta entry fails to decode by @hzcheng in #33279
- docs: add taos_print_row desc by @qevolg in #33310
- test: tidy up cases on main branch by @DuanKuanJun in #33317
- fix: Support external window for subquery. by @Simon9997 in #33320
- fix(tmq): [TS-7468] position is negative because overflow by @wangmm0220 in #33304
- fix(tmq): [TS-7468] position is negative because overflow by @wangmm0220 in #33305
- enh(stream): fix trim block error by @wangmm0220 in #33299
- fix: [TD-38315] Fix virtual supertable scan wrong tsSlotId. by @Simon9997 in #33288
- enh:remove obsolete test case files for long-running and TD-GPT tests from the parallel_test directory by @tomchon in #33327
- change log level of http by @yihaoDeng in https://github.com/taosda...
3.3.8.1
Behavior change and compatibility
Features
Enhancements
- enh: support for alter RSMA
Fixes
- fix: incorrect results were returned when executing first and last functions on the timestamp column simultaneously
- fix: precision loss when taosX synchronizes decimal data
- fix: incorrect first window calculation results after taosd restart when stream is triggered periodically.
- fix: show local variables like 'timezone' displayed incorrectly on the Windows platform
- fix: resolved issue where no error was reported after specifying the DELETE_RECALC option for count window in stream
- fix: fix some Explorer typos
- fix: move_to failed since cross-dev
- fix: crash occurs while WebSocket reconnects when using STMT
- fix: the disk flush thread may deadlock during heavy write and query operations
- fix: resolved incorrect end_point information in perf_connections
- fix: tag filtering did not take effect when subscribing to a topic with tag selection conditions
What's Changed
- test: remove check for period recalc. by @xiao-77 in #33146
- feat: add status check on compatibility cases. by @xiao-77 in #33065
- fix: order by errors by @Tony2h in #33058
- fix: correct log message formatting in taosd startup by @tomchon in #33157
- docs: update release note for 3.3.8.0 in office web by @feici02 in #33155
- fix: resolved incorrect end_point information in perf_connections by @yihaoDeng in #33159
- docs: update pkg to 3.3.8.0 and use pkgType to get version url by @tomchon in #33162
- docs: update pkg to 3.3.8.0 by @tomchon in #33163
- fix: last error by @facetosea in #33151
- docs: update TDengine package version to 3.3.8.0 by @tomchon in #33164
- fix: [TD-38160] Disable delete_recalc when trigger window is count wi… by @Simon9997 in #33132
- Docs/ipv6Update by @yihaoDeng in #33167
- test:move docs tests and unit tests to new framework by @tomchon in #33148
- fix: remove unsupported branches from pull request triggers in workflow by @tomchon in #33169
- fix: last ERROR by @facetosea in #33166
- enh(stream): remove synchronous wait for runner by @JinqingKuang in #33154
- fix: dead lock caused by pthread_cond_destroy by @kailixu in #33168
- merge: from 3.3.6 to main branch by @guanshengliang in #33171
- fix: remove unnecessary jsonPath attribute and add tdgpt download url by @tomchon in #33175
- docs: support rollup sma by @kailixu in #33176
- Uncatalog 1-insert/2-query case migrate to catalog by @DuanKuanJun in #32977
- fix: update links to issue references in release notes for clarity by @tomchon in #33179
- refactor(gpt): update doc and error msg. by @hjxilinx in #33156
- fix: replace DocCardList with SortedDocCardList in release notes by @tomchon in #33183
- fix(tz): timezone display error in windows by @wangmm0220 in #33170
- fix(tz): timezone display error in windows by @wangmm0220 in #33190
- fix(tmq): [ts7402]tag filter do not work if topic is stable with filter by @wangmm0220 in #33191
- fix(tmq): [ts7402]tag filter do not work if topic is stable with filter by @wangmm0220 in #33143
- fix(stream): [TD35698]decimal data error if snapshot is true by @wangmm0220 in #33189
- fix(stream): [TD35698]decimal data error if snapshot is true by @wangmm0220 in #33149
- enh(rsma): support alter/decimal/composite key by @kailixu in #33177
- docs: fix desc errors in taosgen's document by @YamingPei in #33172
- fix:stmt core by @Pengrongkun in #33196
- merge: from 3.3.6 to main by @guanshengliang in #33200
- docs: fix python examples error by @menshibin in #33199
- fix: conditionally copy scripts and update configuration instructions for non-lite package mode by @tomchon in #33188
Full Changelog: ver-3.3.8.0...ver-3.3.8.1
3.3.8.0
Behavior change and compatibility
Features
- feat: taosX performance report
- feat: support for TLS certificate-based authentication and transmission
- feat: add 'timezone' option in rust websocket connection
- feat: stream now supports the delete_output_table option
- feat: state_window in stream now supports performing operations on the state column
- feat: stream supports the recognition of virtual table changes
- feat: partition by tag now supports string operations
- feat: JDBC WebSocket support multiple endpoints for load balance
- feat: re-implement TSMA using the refactored stream
- feat: stream computing now supports notification filtering mechanism
- feat: support PROPHET algorithm in TDgpt
- feat: support Pearson correlation coefficient function
- feat: taosX support parsing
keylike value in kafka - feat: support for the date function
- feat: support for functions: IF, ISNULL, ISNOTNULL, NVL, COALESCE, NULLIF, IFNULL
- feat: support for functions: std variance stddev_samp var_samp group_concat
- feat: support Rollup SMA.
- feat: support scanning the integrity of time-series data files using the scan command
- feat: add C connector performance benchmark
- feat: support for find_in_set, like_in_set, regexp_in_set functions
- feat: JDBC reduce query times for high-efficient validation
- feat: TDgpt support imputation function
- feat: explorer report metrics to taoskeeper
Enhancements
- enh: support configuration of state window start and end points
- enh: keep agent online by default even if taosX disconnected
- enh: improve C WebSocket STMT2 performance
- enh: add show ssmigrate command to show the progress of shared storage migration
- enh: optimize the performance of stream computing.
- enh: add perf parameters for influxdb in Explorer-DataIn
- enh: taos shell supports argument values immediately following names on Windows
- enh: optimize db size & query speed in taosX start up
- enh: cache validation result to reduce license query times
- enh: notify statement in stream supports using column aliases
- enh: add cpu usage percentage of taosAdapter metric
- enh: taosgen add support for write TDengine with individual queues
- enh: explorer support contains_bad parameter in OPCDA
- enh: enhance error handling for subscribe error in Adapter
- enh: STMT2 support decimal type
- enh: support for BSS (Byte-Stream-Split) encoding on floating-point data
- enh: optimized the "Balance Vgroup Leader" command to achieve a more uniform distribution of VGroup leader
- enh: separate data query and metadata query processing threads
- enh: change default database params to vgroups=4, duration=10 in Explorer
- enh: support for REDISTRIBUTE command on dual-replica databases
- enh: update standard deviation calculation to prevent potential numeric overflow
- enh: show field names even though all values are null in UDT
- enh: allow explorer create database with replica
- enh: adapter recording sql csv add appName and srcPort
- enh: improve the efficiency of event_window queries grouped by tbname
- enh: alert udt error when running with rhai udt scripts in taosX
Fixes
- fix: out-of-bounds error in table name/Tag calculation during stream processing
- fix: data subscription cannot obtain the creation events of normal tables generated by stream
- fix: resolved issue where calling the forecast function on super virtual tables failed
- fix: taosX special params(sparse/realtime/stables) cause 'No valid epSet' error
- fix: taosX-influxdb process not exit when task done
- fix: unexpected agent activities in explorer
- fix: write part column is not work
- fix: incorrect watermark judgment when the ignore_disorder option is enabled in stream
- fix: RAND function returns different values even seed is same on windows
- fix: the output of 'leastsquares' is inconsistent across compilers
- fix: taosd crash when triggered by virtual table with tbname used as a prefilter
- fix: inconsistent data and log directories on windows
- fix: websocket connection not closed after taos_close
- fix: fix the same filename for log to c native
- fix: memory leak caused by STMT query errors
- fix: taosAdapter json serialization contains unexpected escapes
- fix: create taosX task for pi error via Explorer
- fix: incorrect calculation in the first window when the FILL_HISTORY option is enabled in stream computing
- fix: resolved manual recalculation logic errors in stream
- fix: incorrect calculation results in stream when data is out-of-order or deleted
- fix: consumer.recv_timeout block runtime in rust connector
- fix: STMT2 reports error when binding empty nchar type
- fix: cloud taosX license validation issue
- fix: crash issue caused by commit thread suspending queries on composite primary keys of Varchar type
- fix: fix taosX/explorer too many open files in linux
- fix: fix poll deadline elapsed issue when timeout=never in rust taos-ws
- fix: taosd crash when executing a large number of concurrent last queries
- fix: the cols function returns incorrect results when fetching multiple timestamps
- fix: remove stream creation wizard in explorer, use sql directly
- fix: TDgpt may fail during concurrent forecast
- fix: the issue that ss_keeplocal cannot be set to 1440m
- fix: fix cases in explorer permission management
- fix: no need to alert when taosX_sys not exist in TDLite
- fix: fix influxdb stopping stuck in taosX
- fix: explicitly show the database name is case-sensitive
- fix: Explorer favorite SQL should be case-sensitive
- fix: influxdb multi tags with same ts would cause data lost
- fix: Explorer should use COMPOSITE KEY instead of PRIMARY KEY
- fix: taosAdapter did not report metrics continuously
- fix: ODBC timestamp precision error in ADB UPDATE with ms or ns ts
- fix: Kafka data source validation error after upgrading with SASL config
- fix: fix deadlock issue in concurrent influxdb migration tasks
- fix: preview table contains old fields after payload schema changed in Explorer
- fix: crash in ss-migration when fileset does not exist
- fix: taosBenchmark interlace_rows param not work if non_stop_mode=yes
- fix: consumer recv_timeout cause tmq2local file not completed
- fix: cancel restore task not work
What's Changed
- mereg: from main to 3.0 branch by @guanshengliang in #32343
- enh: grant support for data source ORC by @kailixu in #32377
- fix: modify the execution order of compatibility test cases. by @xiao-77 in #32386
- merge: from main to 3.0 branch by @guanshengliang in #32399
- fix: update dnode state from offline to online by @kailixu in #32422
- feat(stmt):add more cases by @Pengrongkun in #32453
- fix: correct regex pattern for Python case detection and update allure path by @tomchon in #32490
- case: test_idmp_meters.py stream8 fixed (3.0) by @DuanKuanJun in #32513
- fix: merge sort in column insert mode by @kailixu in #32502
- enh[ts-6869]: support using file system as shared storage by @localvar in #32483
- merge: from main to 3.0 branch by @guanshengliang in #32542
- feat(stream): opti thread mode of stream reader by @wangmm0220 in #32546
- support stmt2 test cases by @minhuinie in #32533
- merge: from main to 3.0 branch by @guanshengliang in #32624
- fix: add maxRetryWaitTime to configuration dictionary by @tomchon in #32630
- fix: increase pytest timeout from 1000 to 1200 seconds by @tomchon in #32663
- enh: support for BSS (Byte-Stream-Split) encoding on floating-point data by @hzcheng in #32447
- feat[TD-37210]: trigger scan plan optimize by @Simon9997 in #32633
- enh[TS-6867]: support for REDISTRIBUTE command on dual-replica databases by @cadem in #32468
- fix(agg/stddev): variance overflow by @stephenkgu in #32456
- fix: use new url to download tdengine in compatibility case. by @xiao-77 in #32668
- fix testcases on windows by @minhuinie in #32683
- feat: support for the date function by @Tony2h in #32545
- enh: clarify the return value format of the date function by @Tony2h in #32690
- enh[TD-37432]: add variable 'syncApplyQueueSize' by @localvar in #32562
- merge: from main to 3.0 branch by @guanshengliang in #32686
- feat(stmt2): support insert decimal type by @Pengrongkun in #32563
- Fix win cases by @minhuinie in #32728
- merge: from main to 3.0 branch by @guanshengliang in #32722
- enh: change float/double default encoding to byte_stream_split by @hzcheng in https://github.com/taosdata/TDengin...
3.3.7.5
Behavior change and compatibility
Features
- feat: taosX support importing ORC format
- feat: C WebSocket connection-level timezone
- feat: [TD-37437]: incorrect database targeting when creating streams containing virtual table queries
- feat: support ADO interface in ODBC
- feat: taosAdapter support recording sql to csv
Enhancements
- enh: set EXPLORER_SKIP_REGISTER=true to skip register in Explorer
- enh: reduce taosX binary size for nearly ~60M(plain, 15M compressed)
- enh: explorer will trim spaces in user name
- enh: C WebSocket support configuration options for auto reconnect
- enh: support for formatting time using DDD on Windows.
- enh: disable alert in dashboard on explorer oss
- enh: add verifyPeer parameter to allow users to skip certificate verification during S3 data upload.
- enh: enhance the state control mechanism for S3 data migration to improve precision and efficiency
- enh: explorer can config requret timeout in opcua
- enh: Show Create Table does not output compression information.
- enh: shared storage supports NAS
- enh: support retries in taosBenchmark via ws
- enh: improve kafka datain performance
- enh: taosX not started cause ui undefined error
Fixes
- fix: speedup influxdb 1.x querying and fix oom in taosX influxdb datasource
- fix: create data replication error in explorer with non-default password
- fix: crash caused by race conditions during memory reclamation in long-running queries
- fix: non-exist file cause unstopped failed to open file error in restore
- fix: intermittent “stream task lost” error when creating stream tasks in batches.
- fix: delete stream cause 'Database not specified' in explorer
- fix: varbinary database mapping in explorer transform
- fix: panic in case of decimal converting from oracle
- fix: trigger table tags being null causes crash
- fix: mqtt get sample data timeout if frequency too low
- fix: taosdump export by time range error in case of us/ns precision
- fix: crash issue when using CALC_NOTIFY_ONLY option in stream computing
- fix: taoskeeper audit log error with
value too long for column/tag: client_addressin taoskeeper - fix: import csv with value field in explorer cause error
- fix: explorer cascading tag table list error in case of same values in multi tag fields
- fix: taosX got unexpected null values in case of different types in single field
- fix: nginx service restart cause explorer error
What's Changed
- Feat/ts 6100 3.0 by @wangmm0220 in #32326
- merge: from main to stream by @guanshengliang in #32342
- test: verify bug4 merge case to vehicle.py by @DuanKuanJun in #32328
- feat: rename docker image by @feici02 in #32346
- test: modify recalc ci cases. by @xiao-77 in #32318
- test: update tese case of blob by @yihaoDeng in #32330
- test: modify case test_recalc_manual_with_options.py. by @xiao-77 in #32348
- fix invalide read epset by @yihaoDeng in #32344
- docs: count_window by @facetosea in #32349
- enh: update show creata table by @yihaoDeng in #32320
- test: modify case by @plum-lihui in #32290
- enh: set queryUseMemoryPool to 0 by @jiajingbin in #32351
- fix(stream): fix recalculation range by @JinqingKuang in #32332
- test: add recalc manual to ci. by @xiao-77 in #32361
- fix: split dead loop issue by @dapan1121 in #32354
- fix(stream): fix memory leak of stream notify content by @JinqingKuang in #32364
- fix: [TD-37133] Forbid use %%trows multi times in union query. by @Simon9997 in #32366
- Feat/ts 6100 3.0 ming by @wangmm0220 in #32362
- docs: update release note for 3.3.7.0 in office web by @feici02 in #32359
- test: create vtable stable from 150100 by @DuanKuanJun in #32360
- docs: update stream doc by @guanshengliang in #32374
- docs: add example cases for datatype tests in cases.task by @tomchon in #32379
- docs: update zh introduction with new name by @danielclow in #32382
- merge: from stream branch to main by @guanshengliang in #32375
- enh: grant support for data source ORC by @kailixu in #32370
- enh: grant support for data source ORC by @kailixu in #32378
- fix: wrong col_id in ins_columns by @Tony2h in #32358
- fix: modify the execution order of compatibility test cases. by @xiao-77 in #32385
- test: remove un checked case by @guanshengliang in #32388
- fix: failed to write blob data using STMT2 in inefficient mode by @yihaoDeng in #32365
- fix(parser): subquery use last_row can't found the colname by @hongzhenliu335 in #32353
- test: [TS-6100] Reopen UTs by @Simon9997 in #32363
- docs: explanation of timezone by @wangmm0220 in #32390
- feat(entrypoint): add wait for serverPort and create snode on dnode by @tomchon in #32345
- feat(stmt):add update syntax support for stmt1 by @Pengrongkun in #32367
- docs:update download link in 01-tdengine.md by @tomchon in #32373
- test: [TS-6100] Reopen stream ut by @Simon9997 in #32396
- enh(TD-36909: adjust sync timer routine log by @cadem in #32309
- enh(TD-36909: adjust sync timer routine log by @cadem in #32098
- fix: wrong table number statistics by @hzcheng in #32391
- Fix/hzcheng/3.3.6/TD-37201 by @hzcheng in #32392
- chore: trigger doc build by @feici02 in #32411
- docs: stream upgrade by @guanshengliang in #32408
- fix(gpt): support scalar function in forecast function. by @hjxilinx in #32409
- test: reproduce bug by @guanshengliang in #32414
- chore: trigger doc build by @feici02 in #32416
- docs: add blank line for better readability in product classificationsection by @tomchon in #32417
- docs: escape_character parameter in document classification error by @menshibin in #32421
- test: mute recalc manual case. by @xiao-77 in #32413
- merge: from 3.3.6 to main branch by @guanshengliang in #32389
- docs: update WebSocket connection API support status and usage restrictions by @qevolg in #32393
- fix: fix taoskeeper version by @qevolg in #32425
- fix: fix taoskeeper version by @qevolg in #32429
- fix: enhance removal logic to check for non-empty install directory before deletion by @tomchon in #32430
- fix: update dnode state from offline to online by @kailixu in #32423
- fix: update dnode state from offline to online by @kailixu in #32424
- feat: add taosmqtt support in packaging scripts and cleanup routines by @tomchon in #32431
- doc: simplify get started for docker by @feici02 in #32434
- fix: enhance removal script to handle empty service names and add directory cleanup by @tomchon in #32435
- docs(taosx): update Data-In tasks name to TDengine Subscription and T… by @acerDebugman in #32433
- merge: from 3.3.6 to main branch by @guanshengliang in #32439
- test: reproduce bugs by @guanshengliang in #32446
- fix(tmq): [TD-37063] array capacity is too large in sometimes by @wangmm0220 in #32445
- fix: [TD-37190] Disable ignore_nodata_trigger when window type is not interval/sliding or period. by @Simon9997 in #32405
- docs: add odbc connector support ado by @menshibin in #32460
- fix: Datainserter supports concurrent writing to the same group by @facetosea in #32384
- fix: wildcards pattern match bug in like clause by @Tony2h in #32404
...