stonedb-5.7-v1.0.4-alpha #1920

Nliver · 2023-06-30T11:08:09Z

Nliver
Jun 30, 2023
Maintainer

Release Notes for stonedb-5.7-v1.0.4-alpha

Version Number: 5.7-v1.0.4-alpha
Release Date: 2023-06-30

Stability:

Fixed a crash caused by incremental data when importing data bug: Incremental data causing instance crash. #1805
Fixed a crash caused by the result set of the union all clause, bug: The instance is crashed when extracting data from the union all result set of decimal and integer. #1875
Fixed a crash caused by using aggregate functions in large data scenarios, bug: The instance is crashed if the aggregate function out of bounds #1855

New features

2.1. Support for update ignore syntax feature.

When updating tianmu, records with primary key conflicts will be skipped and subsequent update operations will be performed.
For example:

CREATE TABLE t1  (id int(11) NOT NULL auto_increment,  parent_id int(11) DEFAULT '0' NOT NULL,  level tinyint(4)
DEFAULT '0' NOT NULL, PRIMARY KEY (id)) engine=tianmu;
INSERT INTO t1 VALUES (3,1,1),(4,1,1);

Executing the update ignore t1 set id=id+1; statement will ignore the update of PK=3, because the updated primary key will conflict with PK=4. Then continue to execute the update of pk=4, and the updated PK=5.

mysql>  CREATE TABLE t1  (id int(11) NOT NULL auto_increment,  parent_id int(11) DEFAULT '0' NOT NULL,  level tinyint(4)
         -> DEFAULT '0' NOT NULL, PRIMARY KEY (id)) engine=tianmu;
Query OK, 0 rows affected (0.01 sec)

mysql>   INSERT INTO t1 VALUES (3,1,1),(4,1,1);
Query OK, 2 rows affected (0.01 sec)
Records: 2  Duplicates: 0  Warnings: 0

mysql> update t1 set id=id+1;
ERROR 1062 (23000): Duplicate entry '4' for key 'PRIMARY'
mysql> select * from t1; 
+----+-----------+-------+
| id | parent_id | level |
+----+-----------+-------+
|  3 |         1 |     1 |
|  4 |         1 |     1 |
+----+-----------+-------+
2 rows in set (0.00 sec)

mysql> update ignore t1 set id=id+1;
Query OK, 2 rows affected (0.00 sec)
Rows matched: 2  Changed: 2  Warnings: 0

mysql> select * from t1; 
+----+-----------+-------+
| id | parent_id | level |
+----+-----------+-------+
|  3 |         1 |     1 |
|  5 |         1 |     1 |
+----+-----------+-------+
2 rows in set (0.00 sec)

2.2 Support row format for “load data” statement.

When stonedb is used as the primary database, the load statement will be executed on the backup database in the form of “insert into”.

2.3 Support AggregatorGroupConcat function

mysql> select GROUP_CONCAT(t.id) from sequence t;
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| GROUP_CONCAT(t.id)                                                                                                                                                                         |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| 3000000000010000,3000000000010001,3000000000010002,3000000000010003,3000000000010004,3000000000010005,3000000000010006,3000000000010007,3000000000010008,3000000000010009,3000000000010010 |
+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
1 row in set (0.01 sec)

2.4 Support using select 111 or select 111 from dual scenarios in uion/union all

mysql>  select id from tt union all select 2222 c1 from dual;
+------+
| id   |
+------+
| 1111 |
| 2222 |
+------+

mysql>  select id from tt union all select 2222 ;
+------+
| id   |
+------+
| 1111 |
| 2222 |
+------+
-- PS：select 111(from dual) appears in a position other than that of the first clause

Others Bug fixs

Fix the default value problem of adding columns in the master and slave scenarios. bug: (Primary/Secondary)After an integer column is added,InnoDB defaults to 0, but tianmu defaults to null. #1187
Fix the incorrect result set problem when using case…when in derived table. bug: result of querying a value from an empty derived table have select case is not consistent with innodb #1784
Fix the incorrect result problem caused by precision loss when performing bit operations when the type is time. bug: Bit Operators and Functions problems #1173
Fix the incorrect query result problem caused by overflow when the type is bigint. bug: bigint type, return wrong result; #1564
Fix the incorrect result problem when the filter condition is hexadecimal. bug: When using where to filter hexadecimal formate data, return incorrect #1625
Fix the problem that the default value on the table did not take effect when importing data using the “load data” command. bug: load data , the default value of the field does not take effect #1865
Modify the default field separator of the load command to make it consistent with mysql behavior. bug: load data return error #1609
Fix the query error caused by abnormal metadata. bug: Error 1030 occurred in the query. #1822
Improve MTR stability on github.

What's Changed

docs(downlaod)：update the docs of download(docs: update the docs of Download #1453) by @Nliver in docs(downlaod)：update the docs of download(#1453) #1454
fix(mtr):Resolve the nightly run error problem(bug: nightly run error #1458) by @konghaiya in fix(mtr):Resolve the nightly run error problem(#1458) #1459
fix(workflow): fix can not run lcov in workflow by @RingsC in fix(workflow): fix can not run lcov in workflow #1396
feat(tianmu):New configuration parameters: "tianmu_mandatory" and "tianmu_no_key_error (Add parameters of tianmu_mandatory and tianmu_no_key_error #1462)" by @konghaiya in feat(tianmu):New configuration parameters: "tianmu_mandatory" and "tianmu_no_key_error (#1462)" #1466
fix(tianmu):(Primary/Secondary)Error 1032 occasionally occurs during … by @konghaiya in fix(tianmu):(Primary/Secondary)Error 1032 occasionally occurs during … #1469
test(mtr): add integer/unsigned/in subquery/create temporary testcases and update escape.test(feature: add MTR test cases for StoneDB #1196) by @davidshiz in test(mtr): add integer/unsigned/in subquery/create temporary testcases and update escape.test(#1196) #1471
fix(stonedb): Corrected errors in the documentation and updated the script of the official website(docs: Update the documentation for version 1.0.3 #1494) by @Nliver in fix(stonedb): Corrected errors in the documentation and updated the script of the official website(#1494) #1500
fix(website): fix Baidu statistics script(bug: fix Baidu statistics script #1502) by @Nliver in fix(website): fix Baidu statistics script(#1502) #1503
test(mtr): Optimize parallel scheduling to execute more innodb engine testcases, add date type and std func testcase(feat 8000 ure: add MTR test cases for StoneDB #1196) by @davidshiz in test(mtr): Optimize parallel scheduling to execute more innodb engine testcases, add date type and std func testcase(#1196) #1504
fix(tianmu): fix crash when the aggregated element was decimal (bug: Multithread aggregation occur crash when has decimal #1402) by @adofsauron in fix(tianmu): fix crash when the aggregated element was decimal (#1402) #1506
build(deps): bump nth-check and unist-util-select in /website by @dependabot in build(deps): bump nth-check and unist-util-select in /website #741
docs(stonedb): update the docs by @Nliver in docs(stonedb): update the docs #1509
fix(workflow): remove dup lines in git workflow(bug: Duplicate lines in nightly.yml and pull_reqests.yml #1517) by @zzzz-vincent in fix(workflow): remove dup lines in git workflow(#1517) #1531
feat(tianmu): mv func from public to protected(feature: mv function from public to protected #1501) by @zzzz-vincent in feat(tianmu): mv func from public to protected(#1501) #1527
fix(tianmu):Resolve DDL and insert inot select Possible space inflation issues(bug: alter table cause engine crash #366) by @konghaiya in fix(tianmu):Resolve DDL and insert inot select Possible space inflation issues(#366) #1497
fix(tianmu):The myloader cann't work if the autocommit is closed. (bug: The myloader cann't work if the autocommit is closed. #1510) by @konghaiya in fix(tianmu):The myloader cann't work if the autocommit is closed. (#1510) #1524
fix(core): fix bug: The instance occasionally crashes if both fields … by @wisehead in fix(core): fix bug: The instance occasionally crashes if both fields … #1528
fix: page hover font style by @Agility6 in fix: page hover font style #1535
feat(mtr): To fix the mtr usage by @RingsC in feat(mtr): To fix the mtr usage #1537
fix(tianmu):The mysqld is crashed when you are starting replication.(bug: The mysqld is crashed when you are starting replication. #1523) by @konghaiya in fix(tianmu):The mysqld is crashed when you are starting replication.(#1523) #1540
fix(optmizer):fix the crashes when the right table of hash join is in parallel(bug: The instance occasionally crashes when the parallel degree is enabled of the right table #1538) by @wisehead in fix(optmizer):fix the crashes when the right table of hash join is in parallel(#1538) #1541
feat(tianmu): To support volcano framwork by @RingsC in feat(tianmu): To support volcano framwork #1543
docs(quickstart): add stonedb-8.0 compiling guide docs: add stonedb-8.0 compiling and running guide #1449 by @Double0101 in docs(quickstart): add stonedb-8.0 compiling guide #1449 #1514
fix(website): fix website error docs: add stonedb-8.0 compiling and running guide #1449 by @Double0101 in fix(website): fix website error #1449 #1548
feat(tianmu): support volcano framewrok by @RingsC in feat(tianmu): support volcano framewrok #1546
fix(tianmu): revert code, mv ret value from try block back to catch block. (bug: revert code, mv ret value from try block back to catch block #1532) by @Dysprosium0626 in fix(tianmu): revert code, mv ret value from try block back to catch block. (#1532) #1555
feat(tiamnu): hard code in defs.h (feature: hard code in defs.h #1481) by @zzzz-vincent in feat(tiamnu): hard code in defs.h (#1481) #1533
docs:update the compile guides docs: fix some errors and add more details to complie guide #1562 by @chenshengjiang in docs:update the compile guides #1562 #1565
test(mtr): add more innodb testcases and tianmu range testcase(feature: add MTR test cases for StoneDB #1196) by @davidshiz in test(mtr): add more innodb testcases and tianmu range testcase(#1196) #1569
fix(tianmu):Remove excess log printing and add some code comments(bug: A large table is executed by ddl,the tianmu.log will print a large number of error. #1545) by @konghaiya in fix(tianmu):Remove excess log printing and add some code comments(#1545) #1547
fix(tianmu): fix mysqld crash when exec query with AggregateRough, assert failed on i < m_idx.size() at tianmu_attr.h:387, msg: [bad dpn index 0/0] (bug: mysqld crash when exec query with AggregateRough, assert failed on i < m_idx.size() at tianmu_attr.h:387, msg: [bad dpn index 0/0] #1580) by @adofsauron in fix(tianmu): fix mysqld crash when exec query with AggregateRough, assert failed on i < m_idx.size() at tianmu_attr.h:387, msg: [bad dpn index 0/0] (#1580) #1582
docs(webstie): update the latest website content by @Nliver in docs(webstie): update the latest website content #1589
feat(tianmu): support volcano framework by @RingsC in feat(tianmu): support volcano framework #1554
fix: max-width navbar search style by @Agility6 in fix: max-width navbar search style #1600
feat(website): Update site dependencies and fix some issues by @Nliver in feat(website): Update site dependencies and fix some issues #1606
fix(tianmu):The instance occasionally crashes when the memory leak. (bug: The instance occasionally crashes when the memory leak. #1549) by @konghaiya in fix(tianmu):The instance occasionally crashes when the memory leak. (#1549) #1598
fix(website): fix the wrong QR code(bug: fix the wrong community QR code #1624) by @Nliver in fix(website): fix the wrong QR code(#1624) #1634
fix(tianmu):assert failed on oldv <= dpn_->max_i at pack_int.cpp:337 (bug: assert failed on oldv <= dpn_->max_i at pack_int.cpp:337 #1610) by @konghaiya in fix(tianmu):assert failed on oldv <= dpn_->max_i at pack_int.cpp:337 (#1610) #1627
fix(tianmu): fix mysqld crash when query where JOIN::propagate_dependencies… (bug: mysqld crash when query where JOIN::propagate_dependencies #1628) by @adofsauron in fix(tianmu): fix mysqld crash when query where JOIN::propagate_dependencies… (#1628) #1639
fix(tianmu): fix MySQL server has gone away when exec query (bug: ERROR 2006 (HY000): MySQL server has gone away when exec query #1641 bug: ERROR 1105 (HY000): Unknown error when query #1640) by @adofsauron in fix(tianmu): fix MySQL server has gone away when exec query (#1641 #1640) #1642
fix(tianmu):Support insert ignore syntax (feature: Support insert ignore syntax #1637) by @konghaiya in fix(tianmu):Support insert ignore syntax (#1637) #1643
fix(tianmu): fix query input variables wrong result (bug: When subqueries are associated with input variables and compare with decimal, wrong result. #1647) by @adofsauron in fix(tianmu): fix query input variables wrong result (#1647) #1660
fix(tianmu): fix result of the query using the subquery derived table is incorrect (bug: result of the query using the subquery derived table is incorrect #1662) by @adofsauron in fix(tianmu): fix result of the query using the subquery derived table is incorrect (#1662) #1688
fix(tianmu): fix results of two queries using a derived table and a custom face change are incorrect (bug: results of two queries using a derived table and a custom face change are incorrect #1696) by @adofsauron in fix(tianmu): fix results of two queries using a derived table and a custom face change are incorrect (#1696) #1697
feat(tianmu): Test cases that supplement custom variables (feature: Test cases that supplement custom variables #1703) by @adofsauron in feat(tianmu): Test cases that supplement custom variables (#1703) #1705
fix(tianmu): fix mysqld crash when assigning return values using both custom variables and derived tables (bug: mysqld crash when assigning return values using both custom variables and derived tables #1707) by @adofsauron in fix(tianmu): fix mysqld crash when assigning return values using both custom variables and derived tables (#1707) #1744
fix(tianmu): Insert ignore can insert duplicate values.(bug: Insert ignore can insert duplicate values. #1699) by @konghaiya in fix(tianmu): Insert ignore can insert duplicate values.(#1699) #1746
fix(tianmu): fix error occurred in the union all query result (bug: An error occurred in the union all query result. When one of the sets was empty, the entire query result was overwritten by the null value #1599) by @adofsauron in fix(tianmu): fix error occurred in the union all query result (#1599) #1750
feat(sql): code refactor for misleading-indentation(feature: rm useless code in sql_optimizer.cc #1542) by @zzzz-vincent in feat(sql): code refactor for misleading-indentation(#1542) #1646
docs(quickstart): add stonedb-8.0 compiling guide for CentOS 7.x by @xxq-xu in docs(quickstart): add stonedb-8.0 compiling guide for CentOS 7.x #1756
fix(tianmu):Even if a primary key is defined, duplicate data may be imported.(bug: Even if a primary key is defined, duplicate data may be imported. #1648) by @konghaiya in fix(tianmu):Even if a primary key is defined, duplicate data may be imported.(#1648) #1766
feat: add delete/drop into tianmu log stat by @duanjr in feat: add delete/drop into tianmu log stat #1747
fix(tianmu): fix Error result set of the IN subquery with semi join (bug: Error result set of the IN subquery with semi join #1764) by @adofsauron in fix(tianmu): fix Error result set of the IN subquery with semi join (#1764) #1770
doc(develop-guide): modify method for compile stonedb using docker by @Dysprosium0626 in doc(develop-guide): modify method for compile stonedb using docker #1768
docs: add docker compile guide of stonedb8.0.(docs: add docker compile guide of stonedb8.0 #1780) by @chenshengjiang in docs: add docker compile guide of stonedb8.0.(#1780) #1783
feat(tianmu): remove DBUG_OFF and repalce DEBUG_ASSERT with assert by @duanjr in feat(tianmu): remove DBUG_OFF and repalce DEBUG_ASSERT with assert #1751
fix(tianmu): fix storage of DT type by @duanjr in fix(tianmu): fix storage of DT type #1752
fix(tinmu): fix tianmu crash when set varchar to num when order by by @adofsauron in fix(tinmu): fix tianmu crash when set varchar to num when order by #1807
docs(website): update the documentation for Compile StoneDB 8.0 in Docker(docs: update the documentation for Compile StoneDB 8.0 in Docker #1823) by @davidshiz in docs(website): update the documentation for Compile StoneDB 8.0 in Docker(#1823) #1825
fix(tianmu): fix up the incompatible type by @RingsC in fix(tianmu): fix up the incompatible type #1824
fix(tianmu): Fix up the unknown exception after instance killed randomly by @RingsC in fix(tianmu): Fix up the unknown exception after instance killed randomly #1841
fix(tianmu): fix up the incorrect meta-info leads unexpected behavior by @RingsC in fix(tianmu): fix up the incorrect meta-info leads unexpected behavior #1840
fix(workflow): nightly build failed bug: nightly failed #1830 by @hustjieke in fix(workflow): nightly build failed #1830 #1836
feat(tianmu): revert assert() --> debug_assert() feature: backport to tainmu, remove DBUG_OFF and DBUG #1551 by @hustjieke in feat(tianmu): revert assert() --> debug_assert() #1551 #1842
feat(tianmu): fixup the default delimeter for load data by @RingsC in feat(tianmu): fixup the default delimeter for load data #1843
fix(tianmu): revert PR fix(tianmu): Fix up the unknown exception after instance killed randomly #1841. by @RingsC in fix(tianmu): revert PR #1841. #1850
fix(tianmu): fix up mtr test case for delim of load data command by @RingsC in fix(tianmu): fix up mtr test case for delim of load data command #1854
fix(tianmu): fix up the group_concat function in tianmu by @RingsC in fix(tianmu): fix up the group_concat function in tianmu #1852
fix(tianmu): To fixup the instance crashed if the result of aggregate is out of boundary by @RingsC in fix(tianmu): To fixup the instance crashed if the result of aggregate is out of boundary #1856
docs(developer-guide): update the compiling guide of StoneDB 8.0 for CentOS 7.x docs(developer-guide): update the compiling guide of StoneDB 8.0 for CentOS 7.x #1817 by @xxq-xu in docs(developer-guide): update the compiling guide of StoneDB 8.0 for CentOS 7.x #1817 #1834
fix(tianmu): Fixup the mem leakage of aggregation function by @RingsC in fix(tianmu): Fixup the mem leakage of aggregation function #1867
fix(tianmu): fix UNION of non-matching columns and express with aggregation (bug: 包含内连接和外连接及派生表和子查询的查询结果错误 #1861 feature: ERROR 1105 (HY000): The query includes syntax that is not supported by the storage engine. Tianmu: UNION of non-matching columns (column no 0) . #1864 bug: 当存在decimal数据类型时且派生表中包含union all的查询语句不支持 #1873 bug: UNION clause return error: UNION of non-matching columns (column no 0) #1870) by @adofsauron in fix(tianmu): fix UNION of non-matching columns and express with aggregation (#1861 #1864 #1873 #1870) #1881
test(tianmu): add order by sentence in the mtr case various_join.test by @xxq-xu in test(tianmu): add order by sentence in the mtr case various_join.test #1886
test(mtr): add more test cases for tianmu(feature: add MTR test cases for StoneDB #1196) by @davidshiz in test(mtr): add more test cases for tianmu(#1196) #1888
test(mtr): add order by sentence in the mtr case various_join.test by @xxq-xu in test(mtr): add order by sentence in the mtr case various_join.test #1891
ci(codecov): update the config by @Nliver in ci(codecov): update the config #1898
fix(tianmu): To suuport ignore option for update statement by @RingsC in fix(tianmu): To suuport ignore option for update statement #1884
ci(codecov): update the codecov congfig by @Nliver in ci(codecov): update the codecov congfig #1899
docs(intro): update the support for 8.0 by @Nliver in docs(intro): update the support for 8.0 #1901
workflow(codecov): Filter out excess code files by @Nliver in workflow(codecov): Filter out excess code files #1905
workflow(coverage): Update the lcov running logic(WorkFlow: Optimize the CI/CD for Codecov code coverage detection #1908)(#bug: Two WokFlows failed under Actions #1592) by @Nliver in workflow(coverage): Update the lcov running logic(#1908)(##1592) #1909
fix(tianmu): default value of the field take unaffect in load bug: load data , the default value of the field does not 8000 take effect #1865 by @Double0101 in fix(tianmu): default value of the field take unaffect in load #1865 #1896
fix(tianmu): To support union(all) the statement which is without from clause by @RingsC in fix(tianmu): To support union(all) the statement which is without from clause #1887
fix(tianmu): To remove unnessary optimization in tianmu by @RingsC in fix(tianmu): To remove unnessary optimization in tianmu #1911
fix(tianmu): hotfix corruption in ValueOrNull under multi-thread by @RingsC in fix(tianmu): hotfix corruption in ValueOrNull under multi-thread #1869
fix(tianmu): incorrect result when using where expr and args > bigint_max bug: bigint type, return wrong result; #1564 by @Double0101 in fix(tianmu): incorrect result when using where expr and args > bigint_max #1564 #1902
fix(tianmu): add TIME_to_ulonglong_time_round process and fix up precision loss problem (bug: Bit Operators and Functions problems #1173) by @xxq-xu in fix(tianmu): add TIME_to_ulonglong_time_round process and fix up precision loss problem (#1173) #1895

New Contributors

@zzzz-vincent made their first contribution in fix(workflow): remove dup lines in git workflow(#1517) #1531
@Agility6 made their first contribution in fix: page hover font style #1535
@Dysprosium0626 made their first contribution in fix(tianmu): revert code, mv ret value from try block back to catch block. (#1532) #1555
@xxq-xu made their first contribution in docs(quickstart): add stonedb-8.0 compiling guide for CentOS 7.x #1756
@duanjr made their first contribution in feat: add delete/drop into tianmu log stat #1747

Full Changelog: 5.7-v1.0.3-GA...5.7-v1.0.4-alpha

This discussion was created from the release stonedb-5.7-v1.0.4-alpha.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

StoneAtom

stonedb-5.7-v1.0.4-alpha #1920

Uh oh!

{{title}}

Uh oh!

Replies: 0 comments

Select a reply

Uh oh!

StoneAtom

stonedb-5.7-v1.0.4-alpha #1920

Uh oh!

Nliver Jun 30, 2023 Maintainer

Release Notes for stonedb-5.7-v1.0.4-alpha

Stability:

New features

2.1. Support for update ignore syntax feature.

2.2 Support row format for “load data” statement.

2.3 Support AggregatorGroupConcat function

2.4 Support using select 111 or select 111 from dual scenarios in uion/union all

Others Bug fixs

What's Changed

New Contributors

Replies: 0 comments

Nliver
Jun 30, 2023
Maintainer