Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[docs](query-accel) refine several statements in docs #29716

Merged
merged 2 commits into from
Jan 11, 2024
Merged

[docs](query-accel) refine several statements in docs #29716

merged 2 commits into from
Jan 11, 2024

Conversation

freemandealer
Copy link
Contributor

Proposed changes

Issue Number: close #xxx

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

@freemandealer
Copy link
Contributor Author

run buildall

@freemandealer
Copy link
Contributor Author

run buildall

@freemandealer
StatisticCache->StatisticsCache
4cbef1c 
Signed-off-by: freemandealer <[email protected]>
@freemandealer
Copy link
Contributor Author

run buildall

@github-actions GitHub Actions
Copy link
Contributor

PR approved by anyone and no changes requested.

@doris-robot
Copy link

TPC-H: Total hot run time: 38702 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 4cbef1c46e650e3a258602883db94cc183d9f00b, data reload: false

------ Round 1 ----------------------------------
q1	17956	5073	4974	4974
q2	2049	146	142	142
q3	10683	1084	1104	1084
q4	10318	801	833	801
q5	7871	3150	3197	3150
q6	203	125	126	125
q7	887	506	488	488
q8	9257	1944	1999	1944
q9	6679	6514	6464	6464
q10	8251	3059	3103	3059
q11	403	201	212	201
q12	362	191	194	191
q13	18221	3428	3447	3428
q14	243	219	215	215
q15	553	526	504	504
q16	430	380	383	380
q17	943	521	553	521
q18	7282	6740	6711	6711
q19	1565	1400	1313	1313
q20	565	295	297	295
q21	2760	2406	2396	2396
q22	373	337	316	316
Total cold run time: 107854 ms
Total hot run time: 38702 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4938	4990	4916	4916
q2	309	204	209	204
q3	3321	3337	3305	3305
q4	2232	2225	2238	2225
q5	5797	5811	5813	5811
q6	191	119	119	119
q7	2316	1861	1839	1839
q8	3498	3551	3585	3551
q9	8923	8823	8841	8823
q10	3747	3809	3837	3809
q11	559	432	434	432
q12	784	617	600	600
q13	6926	3292	3209	3209
q14	282	258	275	258
q15	556	511	511	511
q16	518	470	463	463
q17	2089	2031	2001	2001
q18	8726	8444	8291	8291
q19	1602	1575	1605	1575
q20	2164	1942	1919	1919
q21	6087	5750	5684	5684
q22	596	487	506	487
Total cold run time: 66161 ms
Total hot run time: 60032 ms

@doris-robot
Copy link

(From new machine)TeamCity pipeline, clickbench performance test result:
the sum of best hot time: 45.74 seconds
stream load tsv: 564 seconds loaded 74807831229 Bytes, about 126 MB/s
stream load json: 19 seconds loaded 2358488459 Bytes, about 118 MB/s
stream load orc: 66 seconds loaded 1101869774 Bytes, about 15 MB/s
stream load parquet: 32 seconds loaded 861443392 Bytes, about 25 MB/s
insert into select: 21.5 seconds inserted 10000000 Rows, about 465K ops/s
storage size: 17183960375 Bytes

@doris-robot
Copy link

TPC-DS: Total hot run time: 178686 ms 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 4cbef1c46e650e3a258602883db94cc183d9f00b, data reload: false

query1	932	339	323	323
query2	6727	1819	1902	1819
query3	6713	216	211	211
query4	25902	22186	22263	22186
query5	5600	496	499	496
query6	283	197	193	193
query7	4624	280	278	278
query8	249	211	205	205
query9	9196	2785	2725	2725
query10	552	254	254	254
query11	16240	15367	15448	15367
query12	138	83	75	75
query13	1625	341	336	336
query14	12073	7252	7146	7146
query15	254	196	197	196
query16	6489	279	264	264
query17	1900	489	483	483
query18	1952	267	265	265
query19	287	147	142	142
query20	81	80	78	78
query21	183	96	85	85
query22	4851	4870	4652	4652
query23	31906	31451	31424	31424
query24	11112	2840	2769	2769
query25	584	346	343	343
query26	1572	153	150	150
query27	2872	290	282	282
query28	6939	1909	1883	1883
query29	1657	399	401	399
query30	280	146	152	146
query31	967	768	787	768
query32	96	62	53	53
query33	728	268	268	268
query34	903	443	430	430
query35	859	744	731	731
query36	1394	1363	1304	1304
query37	101	65	68	65
query38	3402	3257	3301	3257
query39	1339	1289	1288	1288
query40	300	101	93	93
query41	38	34	33	33
query42	102	95	96	95
query43	528	510	461	461
query44	1036	694	713	694
query45	209	190	178	178
query46	1060	684	663	663
query47	1750	1664	1683	1664
query48	397	322	320	320
query49	1134	305	331	305
query50	779	322	321	321
query51	5388	5286	5268	5268
query52	100	86	92	86
query53	229	150	152	150
query54	1466	567	583	567
query55	97	91	88	88
query56	222	208	199	199
query57	994	969	960	960
query58	232	217	209	209
query59	2705	2485	2483	2483
query60	273	246	232	232
query61	86	84	80	80
query62	669	468	474	468
query63	179	153	148	148
query64	4930	1749	1678	1678
query65	3356	3260	3287	3260
query66	1182	352	332	332
query67	15820	15727	15092	15092
query68	13082	537	542	537
query69	557	276	292	276
query70	1832	1602	1568	1568
query71	507	231	210	210
query72	4840	2817	2849	2817
query73	3213	319	332	319
query74	7093	6436	6524	6436
query75	5422	2360	2254	2254
query76	6393	1144	1115	1115
query77	698	274	261	261
query78	10018	8524	8523	8523
query79	1064	521	511	511
query80	589	343	355	343
query81	453	208	215	208
query82	204	94	88	88
query83	192	138	138	138
query84	273	54	57	54
query85	886	286	278	278
query86	387	397	384	384
query87	3595	3398	3353	3353
query88	3056	2328	2321	2321
query89	351	263	272	263
query90	1906	218	194	194
query91	166	144	129	129
query92	58	54	54	54
query93	1320	430	487	430
query94	883	192	185	185
query95	478	434	432	432
query96	628	326	336	326
query97	4319	4178	4165	4165
query98	218	191	185	185
query99	1119	878	863	863
Total cold run time: 294623 ms
Total hot run time: 178686 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.31 s 
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit 4cbef1c46e650e3a258602883db94cc183d9f00b, data reload: false

query1	0.10	0.06	0.05
query2	0.06	0.02	0.02
query3	0.25	0.12	0.10
query4	1.76	0.12	0.11
query5	0.53	0.52	0.53
query6	1.36	0.64	0.63
query7	0.02	0.02	0.01
query8	0.04	0.03	0.03
query9	0.56	0.51	0.51
query10	0.55	0.54	0.54
query11	0.13	0.09	0.09
query12	0.12	0.10	0.09
query13	0.61	0.60	0.59
query14	0.76	0.79	0.81
query15	0.83	0.80	0.81
query16	0.35	0.35	0.35
query17	0.96	0.98	1.01
query18	0.25	0.27	0.25
query19	1.83	1.79	1.66
query20	0.02	0.01	0.01
query21	15.40	0.59	0.57
query22	2.50	2.37	1.35
query23	17.27	0.92	0.76
query24	5.32	0.81	1.10
query25	2.03	0.19	0.15
query26	0.14	0.14	0.13
query27	0.15	0.15	0.16
query28	9.10	0.84	0.81
query29	12.61	3.41	3.28
query30	0.60	0.50	0.49
query31	2.81	0.36	0.35
query32	3.34	0.49	0.49
query33	3.24	3.25	3.21
query34	15.80	4.18	4.16
query35	4.17	4.16	4.14
query36	1.10	1.05	1.05
query37	0.07	0.05	0.06
query38	0.03	0.03	0.03
query39	0.03	0.02	0.02
query40	0.16	0.12	0.13
query41	0.07	0.02	0.02
query42	0.03	0.02	0.02
query43	0.03	0.02	0.02
Total cold run time: 107.09 s
Total hot run time: 30.31 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit 4cbef1c46e650e3a258602883db94cc183d9f00b with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       15.0 seconds inserted 10000000 Rows, about 666K ops/s

dataroaring
dataroaring approved these changes Jan 11, 2024
View reviewed changes
Copy link
Contributor

@dataroaring dataroaring left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Jan 11, 2024
@github-actions GitHub Actions
Copy link
Contributor

PR approved by at least one committer and no changes requested.

@yiguolei yiguolei merged commit b0a86c7 into apache:master Jan 11, 2024
27 of 28 checks passed
yiguolei pushed a commit that referenced this pull request Jan 12, 2024
@freemandealer @Doris-Extras
[docs](query-accel) refine several statements in docs (#29716)
9b7bbb5
yiguolei pushed a commit that referenced this pull request Jan 12, 2024
@freemandealer @Doris-Extras
[docs](query-accel) refine several statements in docs (#29716)
3ef1229
wsjz pushed a commit to wsjz/incubator-doris that referenced this pull request Feb 4, 2024
@freemandealer @wsjz
[docs](query-accel) refine several statements in docs (apache#29716)
ba68e31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@Jibing-Li Jibing-Li Jibing-Li approved these changes

@dataroaring dataroaring dataroaring approved these changes

Assignees
No one assigned
Labels
approved Indicates a PR has been approved by one committer. dev/3.0.0-merged reviewed
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
5 participants
@freemandealer @doris-robot @Jibing-Li @dataroaring @yiguolei