Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Enhancement](test) Add function test templates #40462

Merged
merged 1 commit into from
Sep 14, 2024
Merged

[Enhancement](test) Add function test templates #40462

merged 1 commit into from
Sep 14, 2024

Conversation

zclllyybb
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

@doris-robot
Copy link

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR

Since 2024-03-18, the Document has been moved to doris-website.
See Doris Document.

@zclllyybb
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Sep 6, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 37966 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit e1769fad264a14e05eae888d436fb0a5f631b63a, data reload: false

------ Round 1 ----------------------------------
q1	17597	4758	4309	4309
q2	2019	185	188	185
q3	11747	970	1122	970
q4	10519	754	694	694
q5	7766	2845	2827	2827
q6	229	141	140	140
q7	951	621	600	600
q8	9311	2071	2073	2071
q9	7127	6514	6539	6514
q10	7001	2199	2178	2178
q11	469	248	245	245
q12	419	227	226	226
q13	18862	3110	3090	3090
q14	270	240	239	239
q15	530	496	477	477
q16	517	429	428	428
q17	1003	707	682	682
q18	7309	6836	6838	6836
q19	1385	1065	958	958
q20	674	335	341	335
q21	3937	2962	2957	2957
q22	1129	1037	1005	1005
Total cold run time: 110771 ms
Total hot run time: 37966 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4336	4248	4250	4248
q2	381	272	272	272
q3	2832	2654	2647	2647
q4	1933	1646	1627	1627
q5	5625	5664	5731	5664
q6	231	138	137	137
q7	2213	1817	1802	1802
q8	3289	3413	3467	3413
q9	8784	8812	8792	8792
q10	3582	3403	3397	3397
q11	615	504	507	504
q12	859	680	657	657
q13	13603	3199	3249	3199
q14	319	304	298	298
q15	534	488	495	488
q16	557	484	481	481
q17	1832	1513	1552	1513
q18	8183	7744	7920	7744
q19	1754	1643	1690	1643
q20	2150	1909	1907	1907
q21	5704	5414	5431	5414
q22	1134	1036	1067	1036
Total cold run time: 70450 ms
Total hot run time: 56883 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 192586 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit e1769fad264a14e05eae888d436fb0a5f631b63a, data reload: false

query1	1273	890	879	879
query2	6335	1957	1955	1955
query3	10551	4104	3972	3972
query4	59572	25547	23115	23115
query5	5448	494	512	494
query6	400	161	157	157
query7	5775	294	292	292
query8	310	228	235	228
query9	9082	2520	2510	2510
query10	500	279	271	271
query11	18394	14965	15344	14965
query12	153	99	97	97
query13	1566	398	387	387
query14	11142	7295	7332	7295
query15	252	176	182	176
query16	7580	485	473	473
query17	1125	573	578	573
query18	1928	313	291	291
query19	280	152	145	145
query20	120	112	108	108
query21	207	104	113	104
query22	4685	4736	4634	4634
query23	34540	33348	33687	33348
query24	5928	2833	2888	2833
query25	520	388	387	387
query26	679	151	162	151
query27	1792	274	280	274
query28	3799	2039	2040	2039
query29	669	404	416	404
query30	228	160	161	160
query31	937	781	779	779
query32	85	58	60	58
query33	481	313	287	287
query34	877	475	478	475
query35	842	735	735	735
query36	1074	931	937	931
query37	149	83	84	83
query38	3988	3889	3927	3889
query39	1432	1418	1385	1385
query40	201	115	108	108
query41	45	44	44	44
query42	111	95	95	95
query43	549	501	475	475
query44	1100	759	748	748
query45	198	168	164	164
query46	1080	764	713	713
query47	1930	1789	1824	1789
query48	382	298	303	298
query49	768	431	443	431
query50	842	410	435	410
query51	7052	6878	6882	6878
query52	97	88	87	87
query53	256	182	184	182
query54	565	450	493	450
query55	74	75	73	73
query56	288	256	257	256
query57	1157	1085	1091	1085
query58	228	223	231	223
query59	3077	2794	2954	2794
query60	297	254	260	254
query61	100	100	100	100
query62	745	635	662	635
query63	227	184	190	184
query64	2768	724	644	644
query65	3231	3145	3146	3145
query66	654	336	324	324
query67	15345	15288	15171	15171
query68	2965	588	591	588
query69	402	278	281	278
query70	1166	1133	1037	1037
query71	353	279	270	270
query72	5342	4101	3967	3967
query73	763	331	332	331
query74	9336	8814	8862	8814
query75	3351	2645	2695	2645
query76	1396	958	1006	958
query77	532	372	328	328
query78	9681	9136	8994	8994
query79	1034	543	532	532
query80	696	497	509	497
query81	458	232	229	229
query82	234	135	139	135
query83	177	149	154	149
query84	263	79	72	72
query85	682	293	282	282
query86	303	268	280	268
query87	4477	4277	4390	4277
query88	2923	2339	2347	2339
query89	374	284	297	284
query90	1885	188	192	188
query91	128	100	95	95
query92	62	48	48	48
query93	1062	546	603	546
query94	648	289	299	289
query95	331	248	255	248
query96	581	266	261	261
query97	3211	3114	3090	3090
query98	214	197	192	192
query99	1513	1256	1274	1256
Total cold run time: 304608 ms
Total hot run time: 192586 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.53 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit e1769fad264a14e05eae888d436fb0a5f631b63a, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.05
query4	1.68	0.07	0.07
query5	0.50	0.48	0.50
query6	1.13	0.73	0.73
query7	0.02	0.01	0.01
query8	0.05	0.04	0.05
query9	0.53	0.48	0.49
query10	0.55	0.54	0.52
query11	0.16	0.11	0.12
query12	0.15	0.12	0.12
query13	0.61	0.58	0.58
query14	1.46	1.47	1.41
query15	0.84	0.82	0.84
query16	0.37	0.36	0.38
query17	1.00	1.04	1.00
query18	0.21	0.20	0.20
query19	1.83	1.77	1.79
query20	0.01	0.01	0.01
query21	15.40	0.65	0.65
query22	4.51	6.82	2.16
query23	18.28	1.27	1.26
query24	2.15	0.22	0.22
query25	0.15	0.09	0.08
query26	0.27	0.18	0.17
query27	0.08	0.08	0.08
query28	13.21	1.02	1.00
query29	12.60	3.38	3.31
query30	0.24	0.05	0.06
query31	2.88	0.41	0.39
query32	3.23	0.48	0.46
query33	2.99	2.97	3.00
query34	16.97	4.38	4.47
query35	4.56	4.44	4.48
query36	0.66	0.48	0.48
query37	0.19	0.15	0.15
query38	0.15	0.15	0.14
query39	0.04	0.03	0.04
query40	0.16	0.14	0.13
query41	0.10	0.05	0.05
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 110.37 s
Total hot run time: 31.53 s

@zclllyybb
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Sep 6, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38266 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 9dce1dafda6792270db28b6a78a813eff2ba6205, data reload: false

------ Round 1 ----------------------------------
q1	18417	4564	4407	4407
q2	2029	191	183	183
q3	10456	1196	1088	1088
q4	10183	725	758	725
q5	7728	2852	2791	2791
q6	228	138	136	136
q7	959	615	605	605
q8	9321	2111	2039	2039
q9	7264	6540	6559	6540
q10	7007	2202	2261	2202
q11	476	244	246	244
q12	401	226	216	216
q13	17785	3064	3050	3050
q14	287	234	254	234
q15	541	496	496	496
q16	519	420	451	420
q17	979	670	728	670
q18	7513	6955	6944	6944
q19	1398	1036	1040	1036
q20	680	322	327	322
q21	3961	3062	2899	2899
q22	1144	1053	1019	1019
Total cold run time: 109276 ms
Total hot run time: 38266 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4378	4323	4292	4292
q2	382	275	269	269
q3	2913	2663	2658	2658
q4	1972	1648	1638	1638
q5	5427	5407	5400	5400
q6	219	131	126	126
q7	2079	1745	1704	1704
q8	3236	3366	3364	3364
q9	8502	8444	8462	8444
q10	3468	3173	3159	3159
q11	586	498	532	498
q12	788	623	642	623
q13	12670	3083	3100	3083
q14	312	283	270	270
q15	527	473	503	473
q16	522	495	456	456
q17	1777	1504	1482	1482
q18	7770	7434	7361	7361
q19	1672	1578	1507	1507
q20	2032	1822	1815	1815
q21	5510	5157	5137	5137
q22	1145	1035	1024	1024
Total cold run time: 67887 ms
Total hot run time: 54783 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 187127 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 9dce1dafda6792270db28b6a78a813eff2ba6205, data reload: false

query1	929	377	378	377
query2	6456	1947	1835	1835
query3	6640	206	213	206
query4	31207	23217	22944	22944
query5	4159	506	509	506
query6	253	163	164	163
query7	4578	301	309	301
query8	282	221	235	221
query9	8556	2478	2485	2478
query10	456	279	275	275
query11	17545	15079	15125	15079
query12	160	103	100	100
query13	1650	394	373	373
query14	10197	6849	7143	6849
query15	258	184	171	171
query16	8034	437	426	426
query17	1594	564	550	550
query18	2066	286	277	277
query19	336	150	156	150
query20	121	109	109	109
query21	216	104	104	104
query22	4443	4152	4210	4152
query23	34282	33286	33419	33286
query24	11243	2873	2869	2869
query25	633	377	387	377
query26	1140	155	153	153
query27	2315	274	269	269
query28	7137	2071	2033	2033
query29	822	441	410	410
query30	308	162	151	151
query31	977	786	785	785
query32	92	56	58	56
query33	763	295	286	286
query34	964	466	471	466
query35	865	721	714	714
query36	1118	908	958	908
query37	151	84	87	84
query38	4167	3926	3851	3851
query39	1439	1401	1379	1379
query40	198	115	111	111
query41	50	46	46	46
query42	120	94	93	93
query43	508	469	457	457
query44	1250	768	753	753
query45	200	166	166	166
query46	1106	746	765	746
query47	1906	1810	1832	1810
query48	376	297	294	294
query49	1075	436	457	436
query50	825	409	410	409
query51	7028	6848	6869	6848
query52	101	90	91	90
query53	261	189	183	183
query54	988	509	461	461
query55	72	74	77	74
query56	277	256	251	251
query57	1184	1109	1080	1080
query58	257	217	247	217
query59	3043	2839	2705	2705
query60	298	271	272	271
query61	102	97	99	97
query62	865	633	664	633
query63	213	187	185	185
query64	4234	704	663	663
query65	3249	3139	3166	3139
query66	1412	350	341	341
query67	15702	15183	15378	15183
query68	3124	593	570	570
query69	406	273	268	268
query70	1105	1157	1089	1089
query71	333	274	278	274
query72	6337	4000	4055	4000
query73	747	331	320	320
query74	9195	8902	8800	8800
query75	3406	2721	2735	2721
query76	1898	1077	1028	1028
query77	451	314	301	301
query78	10726	9388	9093	9093
query79	1031	543	534	534
query80	768	496	539	496
query81	503	234	227	227
query82	238	139	138	138
query83	174	151	153	151
query84	221	83	74	74
query85	689	283	274	274
query86	320	301	299	299
query87	4465	4277	4206	4206
query88	3358	2328	2321	2321
query89	386	294	304	294
query90	1931	189	194	189
query91	127	106	125	106
query92	59	50	51	50
query93	1040	553	542	542
query94	870	283	289	283
query95	352	310	249	249
query96	587	261	264	261
query97	3230	3176	3047	3047
query98	210	208	195	195
query99	1464	1262	1279	1262
Total cold run time: 285203 ms
Total hot run time: 187127 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.16 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 9dce1dafda6792270db28b6a78a813eff2ba6205, data reload: false

query1	0.05	0.04	0.04
query2	0.09	0.04	0.04
query3	0.23	0.05	0.05
query4	1.67	0.08	0.09
query5	0.52	0.49	0.52
query6	1.12	0.74	0.73
query7	0.03	0.02	0.01
query8	0.05	0.04	0.05
query9	0.54	0.49	0.49
query10	0.56	0.58	0.55
query11	0.16	0.12	0.11
query12	0.15	0.13	0.12
query13	0.60	0.58	0.58
query14	1.40	1.41	1.41
query15	0.83	0.83	0.82
query16	0.38	0.37	0.37
query17	1.04	0.99	1.00
query18	0.20	0.19	0.20
query19	1.93	1.77	1.78
query20	0.01	0.01	0.02
query21	15.40	0.66	0.66
query22	4.35	7.27	1.59
query23	18.27	1.37	1.29
query24	2.06	0.23	0.21
query25	0.16	0.09	0.09
query26	0.27	0.17	0.17
query27	0.08	0.08	0.08
query28	13.32	1.01	1.01
query29	12.58	3.35	3.26
query30	0.25	0.06	0.05
query31	2.87	0.40	0.40
query32	3.27	0.49	0.48
query33	2.97	2.99	2.99
query34	16.88	4.43	4.46
query35	4.45	4.46	4.47
query36	0.66	0.49	0.49
query37	0.19	0.16	0.15
query38	0.16	0.16	0.15
query39	0.05	0.04	0.04
query40	0.17	0.13	0.13
query41	0.09	0.05	0.06
query42	0.06	0.05	0.06
query43	0.05	0.05	0.04
Total cold run time: 110.17 s
Total hot run time: 31.16 s

@zclllyybb
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Sep 6, 2024

clang-tidy review says "All clean, LGTM! 👍"

@doris-robot
Copy link

TPC-H: Total hot run time: 38132 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 891440d73b92a8396dbf88229b966a687304b474, data reload: false

------ Round 1 ----------------------------------
q1	18536	4759	4353	4353
q2	2026	191	186	186
q3	10506	1166	1144	1144
q4	10162	696	786	696
q5	7725	2864	2780	2780
q6	230	136	139	136
q7	954	601	594	594
q8	9342	2280	2088	2088
q9	7229	6539	6559	6539
q10	7013	2186	2243	2186
q11	469	263	244	244
q12	399	221	223	221
q13	17767	3056	3037	3037
q14	286	230	248	230
q15	530	491	479	479
q16	509	433	430	430
q17	992	702	687	687
q18	7458	6974	6898	6898
q19	1409	1059	973	973
q20	695	344	323	323
q21	3877	2950	2892	2892
q22	1118	1057	1016	1016
Total cold run time: 109232 ms
Total hot run time: 38132 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4371	4346	4278	4278
q2	381	272	277	272
q3	2893	2688	2640	2640
q4	1908	1621	1697	1621
q5	5417	5395	5391	5391
q6	212	131	129	129
q7	2114	1747	1716	1716
q8	3232	3353	3367	3353
q9	8349	8433	8348	8348
q10	3459	3195	3188	3188
q11	600	507	513	507
q12	765	580	609	580
q13	11974	3088	3039	3039
q14	306	266	273	266
q15	516	476	478	476
q16	538	482	488	482
q17	1811	1517	1474	1474
q18	7813	7564	7529	7529
q19	1659	1537	1541	1537
q20	2052	1810	1835	1810
q21	5333	5177	5383	5177
q22	1155	1061	1031	1031
Total cold run time: 66858 ms
Total hot run time: 54844 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.87% (9383/25450)
Line Coverage: 28.23% (77350/273965)
Region Coverage: 27.64% (39953/144547)
Branch Coverage: 24.27% (20335/83774)
Coverage Report: http://coverage.selectdb-in.cc/coverage/891440d73b92a8396dbf88229b966a687304b474_891440d73b92a8396dbf88229b966a687304b474/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 186451 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 891440d73b92a8396dbf88229b966a687304b474, data reload: false

query1	911	377	369	369
query2	6471	1916	1904	1904
query3	6645	204	225	204
query4	34006	23037	22969	22969
query5	4167	504	475	475
query6	249	163	150	150
query7	4579	289	290	289
query8	271	220	214	214
query9	8490	2459	2447	2447
query10	430	265	265	265
query11	16679	14924	15137	14924
query12	155	97	100	97
query13	1631	371	358	358
query14	9789	6993	7222	6993
query15	282	182	170	170
query16	8092	443	444	443
query17	1548	560	546	546
query18	2115	285	279	279
query19	329	139	145	139
query20	116	107	132	107
query21	217	103	99	99
query22	4680	4408	4353	4353
query23	33916	33430	33152	33152
query24	11117	2888	2837	2837
query25	593	388	388	388
query26	1132	149	152	149
query27	2342	269	265	265
query28	7333	2029	2016	2016
query29	800	396	394	394
query30	310	148	144	144
query31	965	713	782	713
query32	99	52	57	52
query33	745	274	271	271
query34	1015	471	469	469
query35	879	728	720	720
query36	1044	896	934	896
query37	153	95	86	86
query38	3948	3891	3840	3840
query39	1445	1381	1378	1378
query40	197	114	111	111
query41	48	45	45	45
query42	116	94	95	94
query43	503	453	457	453
query44	1214	739	731	731
query45	191	163	163	163
query46	1105	779	724	724
query47	1876	1803	1827	1803
query48	353	287	294	287
query49	1101	426	432	426
query50	799	397	410	397
query51	6961	6914	6831	6831
query52	97	86	87	86
query53	249	183	175	175
query54	901	441	483	441
query55	75	76	72	72
query56	271	242	265	242
query57	1178	1088	1053	1053
query58	239	230	239	230
query59	2948	2768	2752	2752
query60	293	268	259	259
query61	104	100	100	100
query62	834	659	651	651
query63	222	185	184	184
query64	4268	710	629	629
query65	3194	3150	3149	3149
query66	1462	343	339	339
query67	15428	15505	15199	15199
query68	3344	599	557	557
query69	388	272	281	272
query70	1127	1123	1103	1103
query71	332	267	269	267
query72	6443	3999	4022	3999
query73	737	323	320	320
query74	9007	8673	8851	8673
query75	3379	2633	2703	2633
query76	1913	970	978	970
query77	501	311	308	308
query78	9623	9048	9132	9048
query79	1015	533	524	524
query80	691	496	490	490
query81	456	231	228	228
query82	245	130	138	130
query83	169	151	150	150
query84	232	87	76	76
query85	683	284	279	279
query86	316	309	277	277
query87	4424	4328	4208	4208
query88	3010	2276	2255	2255
query89	380	292	284	284
query90	1915	189	200	189
query91	120	111	113	111
query92	61	48	48	48
query93	1045	548	609	548
query94	673	298	285	285
query95	337	257	247	247
query96	587	257	257	257
query97	3199	3041	3066	3041
query98	213	195	199	195
query99	1480	1289	1293	1289
Total cold run time: 283960 ms
Total hot run time: 186451 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.33 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 891440d73b92a8396dbf88229b966a687304b474, data reload: false

query1	0.04	0.04	0.04
query2	0.07	0.04	0.04
query3	0.24	0.05	0.04
query4	1.67	0.07	0.07
query5	0.50	0.48	0.50
query6	1.14	0.72	0.72
query7	0.02	0.01	0.02
query8	0.05	0.04	0.05
query9	0.54	0.50	0.48
query10	0.53	0.55	0.55
query11	0.16	0.12	0.12
query12	0.14	0.13	0.12
query13	0.59	0.58	0.59
query14	1.41	1.45	1.44
query15	0.84	0.81	0.81
query16	0.37	0.38	0.38
query17	1.03	0.97	1.00
query18	0.21	0.20	0.19
query19	1.97	1.80	1.78
query20	0.00	0.01	0.01
query21	15.40	0.68	0.67
query22	4.33	7.40	2.01
query23	18.29	1.46	1.27
query24	2.06	0.24	0.21
query25	0.15	0.08	0.08
query26	0.27	0.19	0.17
query27	0.08	0.07	0.08
query28	13.25	1.02	0.99
query29	12.64	3.33	3.30
query30	0.24	0.05	0.05
query31	2.89	0.39	0.39
query32	3.27	0.48	0.47
query33	2.94	2.95	2.98
query34	17.14	4.40	4.37
query35	4.45	4.46	4.41
query36	0.66	0.47	0.48
query37	0.19	0.15	0.15
query38	0.15	0.14	0.14
query39	0.05	0.04	0.04
query40	0.16	0.13	0.12
query41	0.09	0.04	0.04
query42	0.06	0.05	0.05
query43	0.05	0.04	0.04
Total cold run time: 110.33 s
Total hot run time: 31.33 s

@zclllyybb
Copy link
Contributor Author

run buildall

yiguolei
yiguolei previously approved these changes Sep 10, 2024
View reviewed changes
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions bot added approved Indicates a PR has been approved by one committer. reviewed labels Sep 10, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 39077 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 1d3292945ae00f224f720d738bfbbc70c6a21519, data reload: false

------ Round 1 ----------------------------------
q1	17615	4628	4315	4315
q2	2033	191	185	185
q3	10826	1264	1179	1179
q4	10341	741	750	741
q5	8611	2921	2899	2899
q6	233	145	141	141
q7	998	635	613	613
q8	9656	2123	2127	2123
q9	7561	6706	6683	6683
q10	7288	2250	2209	2209
q11	472	263	256	256
q12	400	230	234	230
q13	17781	3096	3147	3096
q14	289	244	251	244
q15	532	496	497	496
q16	541	438	431	431
q17	996	787	796	787
q18	7514	6979	7187	6979
q19	1395	1068	1074	1068
q20	660	340	343	340
q21	3999	3028	3143	3028
q22	1113	1034	1048	1034
Total cold run time: 110854 ms
Total hot run time: 39077 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4393	4297	4301	4297
q2	374	283	269	269
q3	2925	2713	2658	2658
q4	1923	1700	1722	1700
q5	6358	5777	5743	5743
q6	233	135	138	135
q7	2213	1849	1884	1849
q8	3297	3460	3472	3460
q9	9056	9010	8762	8762
q10	3586	3427	3344	3344
q11	613	539	519	519
q12	854	650	655	650
q13	9138	3278	3228	3228
q14	337	296	300	296
q15	523	492	496	492
q16	582	487	503	487
q17	1830	1545	1563	1545
q18	8345	7915	7848	7848
q19	1756	1545	1565	1545
q20	2216	1895	1970	1895
q21	5526	5404	5412	5404
q22	1168	1103	1087	1087
Total cold run time: 67246 ms
Total hot run time: 57213 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.86% (9393/25486)
Line Coverage: 28.24% (77460/274286)
Region Coverage: 27.64% (39992/144689)
Branch Coverage: 24.27% (20343/83834)
Coverage Report: http://coverage.selectdb-in.cc/coverage/1d3292945ae00f224f720d738bfbbc70c6a21519_1d3292945ae00f224f720d738bfbbc70c6a21519/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 197575 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 1d3292945ae00f224f720d738bfbbc70c6a21519, data reload: false

query1	1254	905	917	905
query2	6330	1865	1904	1865
query3	10627	4058	4177	4058
query4	59555	27494	23287	23287
query5	4988	505	502	502
query6	399	163	169	163
query7	5634	297	293	293
query8	323	214	211	211
query9	7736	2487	2489	2487
query10	426	284	281	281
query11	17172	15187	15662	15187
query12	152	102	107	102
query13	1457	438	411	411
query14	10685	7392	7211	7211
query15	202	185	177	177
query16	6793	476	445	445
query17	1099	566	559	559
query18	1424	298	302	298
query19	193	148	147	147
query20	119	111	108	108
query21	205	112	105	105
query22	4876	4346	4436	4346
query23	34393	34065	33186	33186
query24	5931	2926	2854	2854
query25	489	401	397	397
query26	612	158	155	155
query27	1612	278	283	278
query28	3808	2053	2033	2033
query29	651	404	413	404
query30	240	155	151	151
query31	908	760	725	725
query32	72	50	52	50
query33	467	290	294	290
query34	877	486	492	486
query35	832	739	733	733
query36	1022	916	919	916
query37	144	90	81	81
query38	4076	3853	3927	3853
query39	1447	1421	1402	1402
query40	195	115	116	115
query41	47	46	45	45
query42	115	99	96	96
query43	493	467	460	460
query44	1112	753	750	750
query45	196	164	160	160
query46	1102	755	747	747
query47	1891	1807	1815	1807
query48	371	298	300	298
query49	790	446	465	446
query50	810	409	419	409
query51	7037	6880	6884	6880
query52	97	85	90	85
query53	252	176	183	176
query54	568	455	457	455
query55	76	73	79	73
query56	281	260	246	246
query57	1233	1090	1088	1088
query58	220	234	230	230
query59	2862	2711	2843	2711
query60	287	272	280	272
query61	101	107	97	97
query62	764	657	629	629
query63	221	195	188	188
query64	1384	677	678	677
query65	3242	3164	3160	3160
query66	671	342	343	342
query67	15980	15409	15283	15283
query68	1171	876	863	863
query69	421	328	339	328
query70	1133	1185	1161	1161
query71	353	352	336	336
query72	4600	3569	3548	3548
query73	606	596	596	596
query74	8953	8880	8876	8876
query75	3038	2982	2930	2930
query76	991	864	855	855
query77	421	397	395	395
query78	9342	9188	9234	9188
query79	909	881	870	870
query80	820	839	813	813
query81	451	265	262	262
query82	267	264	260	260
query83	194	188	192	188
query84	203	113	109	109
query85	599	407	384	384
query86	307	316	323	316
query87	4560	4434	4374	4374
query88	4273	4155	4167	4155
query89	386	436	369	369
query90	818	313	311	311
query91	122	123	127	123
query92	78	76	77	76
query93	929	931	926	926
query94	400	367	363	363
query95	425	412	414	412
query96	478	474	481	474
query97	3108	3138	3164	3138
query98	227	241	236	236
query99	1311	1273	1282	1273
Total cold run time: 293522 ms
Total hot run time: 197575 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 32.52 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 1d3292945ae00f224f720d738bfbbc70c6a21519, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.22	0.05	0.04
query4	1.68	0.08	0.08
query5	0.51	0.52	0.49
query6	1.13	0.73	0.72
query7	0.02	0.01	0.01
query8	0.06	0.05	0.05
query9	0.54	0.47	0.49
query10	0.55	0.55	0.55
query11	0.16	0.12	0.11
query12	0.15	0.13	0.12
query13	0.60	0.59	0.59
query14	1.43	1.47	1.43
query15	0.85	0.81	0.82
query16	0.37	0.38	0.38
query17	1.06	1.00	1.00
query18	0.21	0.19	0.21
query19	1.93	1.89	1.83
query20	0.01	0.01	0.01
query21	15.39	0.67	0.67
query22	4.33	5.63	2.83
query23	18.35	1.37	1.29
query24	2.19	0.22	0.22
query25	0.15	0.07	0.09
query26	0.28	0.18	0.17
query27	0.07	0.09	0.08
query28	13.24	1.04	1.01
query29	12.61	3.37	3.35
query30	0.24	0.06	0.05
query31	2.89	0.40	0.39
query32	3.24	0.48	0.48
query33	2.99	3.01	3.05
query34	17.23	4.49	4.44
query35	4.52	4.46	4.43
query36	0.66	0.48	0.48
query37	0.17	0.15	0.16
query38	0.15	0.15	0.15
query39	0.05	0.04	0.04
query40	0.16	0.12	0.13
query41	0.09	0.05	0.04
query42	0.06	0.05	0.05
query43	0.04	0.05	0.04
Total cold run time: 110.7 s
Total hot run time: 32.52 s

@suxiaogang223 suxiaogang223 mentioned this pull request Sep 11, 2024
Merged
@github-actions github-actions bot removed the approved Indicates a PR has been approved by one committer. label Sep 14, 2024
@zclllyybb
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 42960 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit fc2a7f7e221d25452b3c85cb878e45e8d92a67c7, data reload: false

------ Round 1 ----------------------------------
q1	17981	7401	7265	7265
q2	2607	205	190	190
q3	10766	1344	1326	1326
q4	10156	1002	998	998
q5	7722	3197	3137	3137
q6	239	152	154	152
q7	1033	629	625	625
q8	9454	2031	2003	2003
q9	6727	6261	6302	6261
q10	7024	2516	2521	2516
q11	428	256	261	256
q12	414	241	236	236
q13	17759	3043	3037	3037
q14	292	244	252	244
q15	589	530	521	521
q16	529	426	429	426
q17	998	959	952	952
q18	7355	6711	6724	6711
q19	1379	1242	1229	1229
q20	620	338	332	332
q21	3914	3548	3543	3543
q22	1075	1000	1032	1000
Total cold run time: 109061 ms
Total hot run time: 42960 ms

----- Round 2, with runtime_filter_mode=off -----
q1	7148	7153	7175	7153
q2	352	233	232	232
q3	2941	2884	2908	2884
q4	1964	1989	1956	1956
q5	5489	5432	5427	5427
q6	234	145	149	145
q7	2078	1726	1695	1695
q8	3224	3336	3293	3293
q9	8430	8436	8394	8394
q10	3402	3447	3477	3447
q11	575	470	473	470
q12	749	564	611	564
q13	6513	3051	3063	3051
q14	290	276	273	273
q15	590	534	523	523
q16	495	451	449	449
q17	1759	1744	1706	1706
q18	8082	7498	7639	7498
q19	1715	1696	1693	1693
q20	2033	1807	1841	1807
q21	5654	5405	5461	5405
q22	1114	1020	1011	1011
Total cold run time: 64831 ms
Total hot run time: 59076 ms

@doris-robot
Copy link

TeamCity be ut coverage result:
Function Coverage: 36.91% (9473/25663)
Line Coverage: 28.26% (77852/275490)
Region Coverage: 27.67% (40212/145319)
Branch Coverage: 24.27% (20426/84152)
Coverage Report: http://coverage.selectdb-in.cc/coverage/fc2a7f7e221d25452b3c85cb878e45e8d92a67c7_fc2a7f7e221d25452b3c85cb878e45e8d92a67c7/report/index.html

@doris-robot
Copy link

TPC-DS: Total hot run time: 195258 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit fc2a7f7e221d25452b3c85cb878e45e8d92a67c7, data reload: false

query1	920	384	378	378
query2	6451	1808	1767	1767
query3	6677	213	221	213
query4	25851	24135	24024	24024
query5	5315	549	525	525
query6	267	181	172	172
query7	4600	319	318	318
query8	277	226	220	220
query9	8503	2587	2592	2587
query10	482	290	285	285
query11	16062	15536	15663	15536
query12	163	102	104	102
query13	1690	414	388	388
query14	11386	6638	7234	6638
query15	216	180	178	178
query16	7612	473	488	473
query17	1523	588	578	578
query18	1988	299	300	299
query19	201	156	157	156
query20	122	114	113	113
query21	219	107	108	107
query22	4520	4066	4381	4066
query23	34357	33887	33761	33761
query24	9923	3134	3106	3106
query25	694	434	428	428
query26	1414	166	167	166
query27	2860	287	290	287
query28	6916	2081	2052	2052
query29	976	446	440	440
query30	307	160	155	155
query31	989	783	832	783
query32	102	59	65	59
query33	744	308	315	308
query34	906	484	483	483
query35	859	761	743	743
query36	1055	891	925	891
query37	174	87	86	86
query38	4078	3960	3925	3925
query39	1449	1444	1394	1394
query40	291	123	119	119
query41	52	50	48	48
query42	122	103	100	100
query43	502	448	443	443
query44	1224	813	791	791
query45	200	174	174	174
query46	1118	857	818	818
query47	1936	1786	1789	1786
query48	376	302	297	297
query49	1149	460	469	460
query50	926	453	466	453
query51	7186	6950	6895	6895
query52	106	91	92	91
query53	262	192	191	191
query54	797	477	475	475
query55	85	79	77	77
query56	298	283	282	282
query57	1209	1080	1081	1080
query58	272	235	240	235
query59	2760	2666	2454	2454
query60	316	283	290	283
query61	127	127	128	127
query62	922	664	671	664
query63	330	198	205	198
query64	5408	672	691	672
query65	3297	3197	3201	3197
query66	1382	295	303	295
query67	15961	15552	15359	15359
query68	3445	883	864	864
query69	434	330	329	329
query70	1198	1161	1183	1161
query71	390	348	345	345
query72	6067	3407	3481	3407
query73	608	597	588	588
query74	9184	9262	9040	9040
query75	3096	3032	3029	3029
query76	1890	866	861	861
query77	430	415	404	404
query78	9806	9226	9369	9226
query79	927	901	877	877
query80	869	850	827	827
query81	446	264	268	264
query82	265	267	265	265
query83	192	190	194	190
query84	231	110	115	110
query85	658	418	401	401
query86	337	308	305	305
query87	4448	4466	4433	4433
query88	4249	4187	4175	4175
query89	385	372	377	372
query90	1294	330	324	324
query91	124	138	124	124
query92	81	75	73	73
query93	1087	1089	1079	1079
query94	627	455	406	406
query95	469	432	430	430
query96	505	486	481	481
query97	3155	3113	3138	3113
query98	228	230	221	221
query99	1543	1366	1280	1280
Total cold run time: 280130 ms
Total hot run time: 195258 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.55 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit fc2a7f7e221d25452b3c85cb878e45e8d92a67c7, data reload: false

query1	0.04	0.04	0.04
query2	0.08	0.04	0.04
query3	0.23	0.05	0.05
query4	1.68	0.07	0.06
query5	0.50	0.50	0.50
query6	1.16	0.74	0.73
query7	0.02	0.01	0.01
query8	0.06	0.04	0.04
query9	0.57	0.52	0.52
query10	0.60	0.60	0.57
query11	0.16	0.12	0.12
query12	0.15	0.12	0.13
query13	0.63	0.61	0.60
query14	1.45	1.47	1.47
query15	0.89	0.86	0.88
query16	0.36	0.36	0.37
query17	1.07	1.04	1.00
query18	0.22	0.21	0.21
query19	1.90	1.82	1.81
query20	0.01	0.01	0.01
query21	15.42	0.68	0.65
query22	4.10	6.71	1.66
query23	18.08	1.36	1.38
query24	2.27	0.23	0.22
query25	0.18	0.08	0.08
query26	0.30	0.18	0.18
query27	0.08	0.08	0.08
query28	13.19	1.14	1.12
query29	12.56	3.39	3.35
query30	0.25	0.06	0.05
query31	2.88	0.42	0.41
query32	3.22	0.51	0.49
query33	3.05	3.05	3.06
query34	15.46	4.33	4.32
query35	4.35	4.33	4.38
query36	0.68	0.49	0.50
query37	0.20	0.17	0.16
query38	0.16	0.15	0.14
query39	0.05	0.04	0.04
query40	0.17	0.13	0.12
query41	0.10	0.05	0.05
query42	0.06	0.05	0.04
query43	0.04	0.04	0.04
Total cold run time: 108.63 s
Total hot run time: 31.55 s

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Sep 14, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@Gabriel39 Gabriel39 merged commit 0f0fdc7 into apache:master Sep 14, 2024
25 of 29 checks passed
@zclllyybb zclllyybb deleted the test_template branch September 15, 2024 06:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@yiguolei yiguolei yiguolei approved these changes

@Mryange Mryange Mryange approved these changes

@zhiqiang-hhhh zhiqiang-hhhh Awaiting requested review from zhiqiang-hhhh

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
6 participants
@zclllyybb @doris-robot @yiguolei @zhiqiang-hhhh @Mryange @Gabriel39