37 Pull requests merged by 19 people

• set upper limit of degree of parallelism for shuffle plan

  #19137 merged Oct 4, 2024

• reduce memory allocation for unique vector in hash build operator

  #19131 merged Oct 2, 2024

• optimize degree of parallelism for shuffle plan

  #19135 merged Oct 2, 2024

• fix TestReLockInRollingRestartCN

  #19047 merged Oct 1, 2024

• remove overlap policy

  #18969 merged Oct 1, 2024

• merge checkpoint add pitr

  #19077 merged Oct 1, 2024

• refactor read related code for physical address column

  #19132 merged Oct 1, 2024

• CI: optimize ut analysis utils

  #19079 merged Oct 1, 2024

• refactoring build_dml_util.go

  #19121 merged Oct 1, 2024

• cherry-pick: fix dashboard

  #19114 merged Oct 1, 2024

• add mo-ctl to get table shards info

  #19063 merged Oct 1, 2024

• move vectors from go heap to offheap

  #19118 merged Oct 1, 2024

• metric: add hashmap and mpool metrics

  #19060 merged Sep 30, 2024

• [bug] proxy: do not need to close client in each connection.

  #19126 merged Sep 30, 2024

• Fix transfer s3 deletes

  #19119 merged Sep 30, 2024

• clean code

  #19095 merged Sep 30, 2024

• Fix cdc bugs

  #19058 merged Sep 30, 2024

• optimize memory allocation in shuffle operator

  #19113 merged Sep 30, 2024

• fix bvt: sum(aggr_count) need consider aggr_count eq 0 in 1.2-dev

  #19111 merged Sep 30, 2024

• prolong sleep time

  #19110 merged Sep 30, 2024

• handle mo crashed when loading data to table with key partition

  #19115 merged Sep 30, 2024

• fix pitr restore valid start time

  #19109 merged Sep 30, 2024

• move batches in join build operator from go heap to offheap

  #19088 merged Sep 30, 2024

• [Subtask]: reduce shuffle memory allocation

  #18980 merged Sep 30, 2024

• remove reference count from batch.

  #19091 merged Sep 30, 2024

• vector: fix wrongly passed offHeap argument

  #19102 merged Sep 30, 2024

• Fix ColRef Error(1.2-dev)

  #19092 merged Sep 30, 2024

• optimize memory allocation in hash build operator by preallocate buffer

  #19099 merged Sep 30, 2024

• move batch in agg operator from go heap to offheap

  #19087 merged Sep 29, 2024

• support extra primary key filters on index

  #19076 merged Sep 29, 2024

• Supplement the compilation of query statistics information

  #19080 merged Sep 29, 2024

• reduce heap allocation during read column data

  #19044 merged Sep 29, 2024

• fix shufflerange miss strvalue

  #19083 merged Sep 29, 2024

• add case for pitr.

  #19001 merged Sep 29, 2024

• reuse hashmap iterator in group operator

  #19073 merged Sep 29, 2024

• fix TestReLockInRollingRestartCN

  #19048 merged Sep 29, 2024

• Fix some bugs in tombstone writer

  #19075 merged Sep 29, 2024

7 Pull requests opened by 7 people

• [feature] add logservice health check method in HAKeeperClient interface

  #19081 opened Sep 29, 2024

• [#18975]Transfer s3 deletes statements

  #19096 opened Sep 29, 2024

• Supplement S3IO statistical attributes

  #19103 opened Sep 30, 2024

• Fix joinorder

  #19107 opened Sep 30, 2024

• set policyOverlap cpu limit to 90%

  #19125 opened Sep 30, 2024

• fileservice: add WrapFileService

  #19134 opened Oct 1, 2024

• fix: fix slice init length

  #19139 opened Oct 4, 2024

19 Issues closed by 9 people

• [Bug]: ut TestSendAny failed

  #18919 closed Oct 1, 2024

• [Bug]: tn can't handle cn s3 tombstone correctly

  #18520 closed Oct 1, 2024

• [Feature Request]: 移除batch引用计数

  #19093 closed Sep 30, 2024

• [Bug]: optimize timestamp in error reported after restore.

  #18977 closed Sep 29, 2024

• [Bug]: Error occurs when running prepare statements

  #18957 closed Sep 29, 2024

• [Subtask]: Sample Clause

  #12812 closed Sep 29, 2024

• [Bug]: [0815] 128-regression: tpch 1t test oom.

  #18150 closed Sep 29, 2024

• [Bug]: [date 9.4]tke regression: tpch 1T 4cn Q9 results incorrect

  #18555 closed Sep 29, 2024

• [Bug]: [date 9.6]tke regression:tpch 1T 4cn Q9 test mo hung

  #18621 closed Sep 29, 2024

• [Bug]: [date 9.20]tke regression: tpch 1T Q18 caused cn oom

  #18901 closed Sep 29, 2024

• [Bug]: tke regression ：sysbench bulk_insert 1000threads test cn and dn oom

  #15201 closed Sep 29, 2024

• [Feature Request]: Support `insert ignore`

  #11224 closed Sep 29, 2024

• [Bug]: [tpcds] mo crashed by oom for query4/query11/query74 of tpcds with 1G scale data on standlone mode

  #18151 closed Sep 29, 2024

• [Bug]: ERROR 20705 (HY000) at line 1: cannot commit a orphan transaction during sysbench testing on distributed mode

  #18922 closed Sep 29, 2024

• [Bug]: cn crashed by FATAL: "vector is not empty" during tpcc and sysbench on daily regression TKE

  #19049 closed Sep 29, 2024

• [Refactoring]: not need to getColumns for each execute in prepare statement

  #18604 closed Sep 29, 2024

• [Bug]: [date 9.24]tke regression：sysbench random_point test reported panic runtime error: index out of range [2] with length 2

  #18992 closed Sep 29, 2024

• [Subtask]: Remove the reference count from the batch and use the copy method to pass batches between pipelines

  #12505 closed Sep 29, 2024

• [Refactoring]: Disable creation of pitr or snapshot to the system database.

  #19022 closed Sep 29, 2024

29 Issues opened by 13 people

• [Bug]: [date 10.2]1.2-dev tke regression: create table or drop database reported cannot commit a orphan transaction

  #19138 opened Oct 3, 2024

• [Bug]: [date 10.1]tke regression: 3cn tpch1T Q18 cn oom

  #19136 opened Oct 2, 2024

• [Bug]: ut TestPartitionBasedShardCanBeCreated failed

  #19133 opened Oct 1, 2024

• [Bug]: [date 9.29]tke regression: mo reported lots of cannot commit a orphan transaction and sysbench test cannot stopped

  #19130 opened Oct 1, 2024

• [Bug]: ut TestHAKeeperClientUpdateCNLabel failed

  #19129 opened Oct 1, 2024

• [Bug]: bvt failed 2

  #19128 opened Sep 30, 2024

• [Bug]: bvt failed.

  #19127 opened Sep 30, 2024

• [Bug]:cn transfer failed in main branch

  #19124 opened Sep 30, 2024

• [Bug]: bvt failed.

  #19123 opened Sep 30, 2024

• [Bug]: DN pod restart

  #19122 opened Sep 30, 2024

• [Feature Request]: refactoring build_dml_util.go

  #19120 opened Sep 30, 2024

• [Bug]: active mo start failed by panic: internal error: read checkpoint CKP[G][2][ckp 341181, truncate 336181](0-0->1727597174306292063-1) failed

  #19116 opened Sep 30, 2024

• [Tech Request]: remove unnecessary logs in task service

  #19112 opened Sep 30, 2024

• [Bug]: select return result is incorrect which where filter condition is unique index

  #19108 opened Sep 30, 2024

• [Bug]: [date 9.29]main standalone regression: create db.table reported error invalid database which database already exists

  #19106 opened Sep 30, 2024

• [Bug]: [date 9.29]standalone regression: mo reported lots of error cannot commit a orphan transaction

  #19105 opened Sep 30, 2024

• [Bug]: The ut test time of multi_upload package is too long

  #19104 opened Sep 30, 2024

• [Bug]: typo in vector.nsp handling

  #19101 opened Sep 30, 2024

• [Bug]: ut failed in TestSyncer_Create

  #19100 opened Sep 30, 2024

• [Bug]: UT failed in Test_ConnectionCount(1.2-dev)

  #19098 opened Sep 29, 2024

• [Bug]: UT failed in TestKill(1.2-dev)

  #19097 opened Sep 29, 2024

• [Bug]: [ERROR] [datasync.go:643] cannot get the last entry when transfering logtail

  #19094 opened Sep 29, 2024

• [Bug]: sharding test report 'internal error: mpool out of space'.

  #19090 opened Sep 29, 2024

• [Bug]: use mo-sysbench to create table with secondary index report panic.

  #19089 opened Sep 29, 2024

• [Bug]: sharding test: the number of replica is incorrect.

  #19086 opened Sep 29, 2024

• [Bug]: mo crashed when loading data to table with key partition

  #19085 opened Sep 29, 2024

• [Bug]: mo-cdc: mo binary(255) do not display the last 0，but mysql display

  #19084 opened Sep 29, 2024

• [Bug]: ut failed in TestMOErrorCanHandled

  #19082 opened Sep 29, 2024

• [Bug]: select time(now());结果为00:00:00

  #19078 opened Sep 29, 2024

89 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• [Refactoring]: Umbrella issue of pipeline refactor

  #10729 commented on Sep 29, 2024 • 0 new comments

• [Subtask]: ALL TPCC queries should have a parallelism of 1

  #13025 commented on Sep 29, 2024 • 0 new comments

• [Tech Request]: [OPT] Rollup

  #12562 commented on Sep 29, 2024 • 0 new comments

• [Bug]: non-voting replica is showed incorrectly for "show logservice replicas;"

  #19062 commented on Sep 29, 2024 • 0 new comments

• [Bug]: file 0191da87-8206-7802-b1be-a3e979bf7edd_00000 is not found when creating partition tables

  #18683 commented on Sep 29, 2024 • 0 new comments

• [Feature Request]: GROUP BY WITH ROLLUP

  #15861 commented on Sep 29, 2024 • 0 new comments

• [Refactoring]: do not create new go routine for TP query

  #18599 commented on Sep 29, 2024 • 0 new comments

• [Tech Request]: archive log

  #11753 commented on Sep 29, 2024 • 0 new comments

• [Feature Request] Load parquet files

  #10162 commented on Sep 29, 2024 • 0 new comments

• [Bug]: mo_cdc: error message optimization

  #18941 commented on Sep 29, 2024 • 0 new comments

• [Bug]: overall issue: refine error info for cdc

  #18911 commented on Sep 29, 2024 • 0 new comments

• [Bug]: master index query reported panic there must be runtime filter in shuffle build

  #18759 commented on Sep 29, 2024 • 0 new comments

• [Bug]: [date 7.5] big data regression: sql 'update big_data_test.table_with_pk_index_for_write_100M set col3 = col3 + 1' report stream closed.

  #17340 commented on Sep 29, 2024 • 0 new comments

• [Tech Request]: support explain pipeline for debug

  #15205 commented on Sep 29, 2024 • 0 new comments

• [Subtask]: Explain the pipeline information of SQL physical plan

  #18620 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming：json data exceeding the int extreme range，stream read extreme data

  #13074 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming: drop dynamic table not succeed

  #13323 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming: json data greater than char or varchar type size，source can read data

  #13329 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming: dynamic table do not read source data which is NULL

  #13370 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming: dynamic table not support primary key constraint

  #13374 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming: kafka consume 1 million rows data in short time，select count from source results inconsistent

  #13409 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming: dynamic table which create as select expression from source read 0 rows

  #13410 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming: cancel connector succeed,but dynamic table do not stop synchronize data

  #13422 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming: dynamic table which source include datetime/timestamp type read 0 rows

  #13571 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming: select date_add from source reported panic error

  #13597 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming: dynamic table which two source table join results error

  #13620 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming: dynamic table in explicit transaction can not read data

  #13629 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming：dynamic table which as select limit offset read 0 rows data

  #13630 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming:insert table which select from source rows affected is less than source rows

  #13649 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming:select outfile dynamic table rows affected error

  #13657 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming: select source reported errror on mo 3cn distributed env

  #13701 commented on Sep 29, 2024 • 0 new comments

• [Bug]: streaming：source can not read one topic which include ten thousands partitions

  #14073 commented on Sep 29, 2024 • 0 new comments

• [Bug]: Incorrect stats in exec_plan

  #14107 commented on Sep 29, 2024 • 0 new comments

• [Bug]: Resource consumption decreases for the same SQL as CN scales out

  #14234 commented on Sep 29, 2024 • 0 new comments

• [Bug]: Create multiple vector indexes for the same vector column ,vector query performance result is incorrect

  #18384 commented on Sep 29, 2024 • 0 new comments

• [Bug]: bit type can not be as primary key

  #18854 commented on Sep 29, 2024 • 0 new comments

• [Bug]: EXTRACT(YEAR FROM a) can not be as hash key in partition table

  #18856 commented on Sep 29, 2024 • 0 new comments

• [Bug]: UNIX_TIMESTAMP func is not allowed for partition function

  #18865 commented on Sep 29, 2024 • 0 new comments

• [Bug]: restore nonsys from pitr report 'internal error: No valid checkpoints for snapshot read,maybe snapshot is too old'

  #19033 commented on Sep 29, 2024 • 0 new comments

• [Bug]: the column 'obj_id' of table mo_catalog.mo_pitr is inconsistent after the table is deleted and the table is created.

  #18970 commented on Sep 29, 2024 • 0 new comments

• [Bug]: [date 9.11]1.2-dev tke regression: sysbench no-pk point select test reported operation error S3: GetObject, exceeded maximum number of attempts, 3

  #18725 commented on Sep 29, 2024 • 0 new comments

• [Bug]: 1.2-dev standalone regression: create db.table reported error invalid database which database already exists

  #18989 commented on Sep 30, 2024 • 0 new comments

• [Bug]: Filter Operator will be release without free in some case

  #18962 commented on Sep 30, 2024 • 0 new comments

• [Bug]: vector index:create index which lists=1000 reported file 018e79d2-44ae-714c-9acf-15798c49c41b_00000 is not found

  #15164 commented on Sep 30, 2024 • 0 new comments

• [Bug]: many cross apply and unnest bugs.

  #18982 commented on Sep 30, 2024 • 0 new comments

• [Bug]: mo_cdc: source_uri which is account:user:role format can not resolved

  #18894 commented on Sep 30, 2024 • 0 new comments

• [Bug]: `internal error: panic delete table failed 16, 32: `

  #18985 commented on Sep 30, 2024 • 0 new comments

• [Bug]: Loading data from cos with the composite primary key is 7 times slower than the single primary key.

  #14397 commented on Sep 30, 2024 • 0 new comments

• [Bug]: [0314] cn oom when running sql 'update table set column = column + 1 where ' in big data test.

  #14960 commented on Sep 30, 2024 • 0 new comments

• [Bug]: performance：sysbench delete test which include auto_increment and index 80% lower performance than non auto_increment index

  #15085 commented on Sep 30, 2024 • 0 new comments

• [Bug]: Excessive objects allocs in `Parser` during sysbench bulk_insert test

  #15239 commented on Sep 30, 2024 • 0 new comments

• [Bug]: [0819] 128-regression: bvt 'select count(1) >= 0 as checked from system.sql_statement_hotspot' panic.

  #18219 commented on Sep 30, 2024 • 0 new comments

• [Bug]: Insert into Table with PK very slow

  #18243 commented on Sep 30, 2024 • 0 new comments

• [Bug]: [0823] main tke regression: tpcc 1000-1000 test panic.

  #18296 commented on Sep 30, 2024 • 0 new comments

• [Bug]: big-data-regression: txn leak.

  #18833 commented on Sep 30, 2024 • 0 new comments

• [Bug]: [big data test]delete from a 100million table takes a long time to execute.

  #17152 commented on Sep 30, 2024 • 0 new comments

• [Bug]: need to intercept pitr restore time.

  #19070 commented on Sep 30, 2024 • 0 new comments

• [Bug]: mo_cdc: restart taskname which not exists execute return ok

  #19029 commented on Sep 30, 2024 • 0 new comments

• [Bug]: mo_cdc: cdc status which is stopped an hour，mo memory not released

  #19009 commented on Sep 30, 2024 • 0 new comments

• [Bug]: mo_cdc: cn restart reported panic error

  #19002 commented on Sep 30, 2024 • 0 new comments

• [Bug]: mo_cdc: drop cdc task error

  #19006 commented on Sep 30, 2024 • 0 new comments

• [Bug]: mo-cdc: mo double type cdc to mysql double type is Inconsistence

  #19034 commented on Sep 30, 2024 • 0 new comments

• [Bug]: CN lost connection

  #9647 commented on Oct 1, 2024 • 0 new comments

• [Bug]: TPMC decreased more than 25 % in daily regression

  #19026 commented on Oct 1, 2024 • 0 new comments

• [Bug]: cn crashed by anic: runtime error: invalid memory address or nil pointer dereference during tpcc and sysbench on daily regression TKE

  #19046 commented on Oct 1, 2024 • 0 new comments

• [Bug]: merge run fail: can not get lastest rows in information_schema.columns

  #18967 commented on Oct 1, 2024 • 0 new comments

• [Bug]: ut failed: TestReLockInRollingRestartCN

  #16739 commented on Oct 2, 2024 • 0 new comments

• [Bug]: ut TestDynamicS3OptsNoRegion failed.

  #16556 commented on Oct 2, 2024 • 0 new comments

• [Bug]: ut TestLockWithBindNotFound and TestUnlockWithBindNotFound failed.

  #17414 commented on Oct 2, 2024 • 0 new comments

• [Bug]: ut TestWaiterAwakeOnDeadLock failed

  #18130 commented on Oct 2, 2024 • 0 new comments

• [Bug]: ut TestHandleBindChangedConcurrently failed.

  #18131 commented on Oct 2, 2024 • 0 new comments

• [Bug]: ut TestGetLockTableBind failed.

  #18132 commented on Oct 2, 2024 • 0 new comments

• [Bug]: ut TestForceRefreshLockTableBinds failed.

  #18133 commented on Oct 2, 2024 • 0 new comments

• [Bug]: ut fails in TestDelete3

  #18521 commented on Oct 2, 2024 • 0 new comments

• [Bug]: ut Test_mce fail panic: io: read/write on closed pipe

  #18965 commented on Oct 2, 2024 • 0 new comments

• [Bug]: ut TestCNFlushS3Deletes failed

  #18900 commented on Oct 2, 2024 • 0 new comments

• [Bug]: ut TestMultiClusterCanWork yields `FATAL log-service taskservice/task_service.go:139 query task by primary key, return 0 records`

  #19018 commented on Oct 2, 2024 • 0 new comments

• [Bug]: ut TestReadDirSymlink failed

  #18855 commented on Oct 2, 2024 • 0 new comments

• [Bug]: TestLockTableBindChanged ci ut fail

  #18976 commented on Oct 2, 2024 • 0 new comments

• [Bug]: ut test failed in TestClientSendWithMsgSize

  #19064 commented on Oct 2, 2024 • 0 new comments

• [Bug]: sysbench test reported error FATAL: Worker threads failed to initialize within 30 seconds!

  #17001 commented on Oct 3, 2024 • 0 new comments

• delay ranges call for dml queries

  #18255 commented on Sep 29, 2024 • 0 new comments

• [exec] implement dedup_join

  #18406 commented on Oct 5, 2024 • 0 new comments

• fileservice: add ObjestStorage.Concurrency

  #18649 commented on Oct 1, 2024 • 0 new comments

• Fulltext index

  #18870 commented on Sep 30, 2024 • 0 new comments

• logs for peak in-use memory

  #18910 commented on Oct 1, 2024 • 0 new comments

• fix convertRowsIntoBatch useless make and then copy

  #18991 commented on Sep 30, 2024 • 0 new comments

• [fix] : avoid the case that increservice may fill duplicated number in multi-CN

  #19031 commented on Sep 30, 2024 • 0 new comments

• load parallel control

  #19032 commented on Sep 29, 2024 • 0 new comments