Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

branch-2.0: [fix](mem leak) fe non_heap mem leak while use jdbc catalog #45806 #47626

Merged
merged 2 commits into from
Feb 10, 2025

Conversation

felixwluo
Copy link
Contributor

What problem does this PR solve?

cherry-pick: #45806

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@Thearas
Copy link
Contributor

Thearas commented Feb 8, 2025

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@felixwluo
Copy link
Contributor Author

run buildall

@felixwluo felixwluo requested a review from zy-kkk February 8, 2025 03:56
@doris-robot
Copy link

TPC-H: Total hot run time: 49043 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f5ca7a155bc4c28c9b0967b531fc8b4aaa0aa588, data reload: false

------ Round 1 ----------------------------------
q1	17650	4378	4378	4378
q2	2049	153	143	143
q3	10291	1875	1911	1875
q4	10361	1235	1312	1235
q5	8482	4023	3889	3889
q6	233	122	147	122
q7	1994	1586	1580	1580
q8	9368	2716	2701	2701
q9	10533	9950	9847	9847
q10	8676	3564	3522	3522
q11	429	254	233	233
q12	477	295	297	295
q13	18392	3953	4016	3953
q14	360	327	331	327
q15	518	456	460	456
q16	554	464	470	464
q17	1145	985	936	936
q18	7252	6771	6829	6771
q19	1712	1527	1530	1527
q20	563	321	322	321
q21	4385	4110	4086	4086
q22	496	382	391	382
Total cold run time: 115920 ms
Total hot run time: 49043 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4392	4271	4308	4271
q2	323	224	223	223
q3	4178	4159	4161	4159
q4	2751	2711	2735	2711
q5	7234	7149	7119	7119
q6	231	127	117	117
q7	3240	2823	2878	2823
q8	4393	4444	4443	4443
q9	14282	13844	14012	13844
q10	4204	4230	4264	4230
q11	793	694	722	694
q12	1035	862	874	862
q13	7113	3755	3760	3755
q14	454	444	420	420
q15	489	445	465	445
q16	634	609	605	605
q17	3904	3817	3832	3817
q18	8692	8782	8769	8769
q19	1718	1660	1673	1660
q20	2357	2117	2102	2102
q21	8594	8402	8526	8402
q22	1035	897	952	897
Total cold run time: 82046 ms
Total hot run time: 76368 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 212463 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f5ca7a155bc4c28c9b0967b531fc8b4aaa0aa588, data reload: false

query1	946	426	379	379
query2	6548	2127	1986	1986
query3	6928	198	200	198
query4	23556	21834	21788	21788
query5	19739	6513	6438	6438
query6	281	217	239	217
query7	4333	297	311	297
query8	262	240	233	233
query9	3080	2637	2575	2575
query10	468	310	307	307
query11	15847	14900	15145	14900
query12	127	75	74	74
query13	1030	443	447	443
query14	17543	13583	13341	13341
query15	393	223	219	219
query16	6484	286	265	265
query17	1915	929	879	879
query18	898	316	321	316
query19	214	152	148	148
query20	96	98	94	94
query21	195	97	92	92
query22	5341	5137	5033	5033
query23	34374	33560	33396	33396
query24	7600	6258	6238	6238
query25	525	449	429	429
query26	1258	164	161	161
query27	2278	298	296	296
query28	6092	2271	2261	2261
query29	2874	2722	2789	2722
query30	249	168	167	167
query31	952	755	739	739
query32	69	68	62	62
query33	453	273	262	262
query34	862	474	481	474
query35	1160	952	950	950
query36	1199	1178	1332	1178
query37	95	61	65	61
query38	3094	2911	2948	2911
query39	1380	1334	1334	1334
query40	309	99	97	97
query41	41	38	37	37
query42	91	84	85	84
query43	632	555	538	538
query44	1173	715	729	715
query45	248	233	234	233
query46	1237	958	949	949
query47	1952	1698	1577	1577
query48	498	422	404	404
query49	659	366	401	366
query50	856	590	596	590
query51	4837	4711	4714	4711
query52	100	74	81	74
query53	223	181	192	181
query54	2640	2427	2511	2427
query55	82	84	83	83
query56	240	202	212	202
query57	1227	1100	1201	1100
query58	223	209	203	203
query59	3402	3328	3241	3241
query60	225	217	213	213
query61	100	95	105	95
query62	859	465	468	465
query63	205	171	176	171
query64	3493	1607	1465	1465
query65	3643	3545	3519	3519
query66	762	442	401	401
query67	15996	15360	15178	15178
query68	9385	656	650	650
query69	505	273	256	256
query70	1701	1316	1279	1279
query71	401	310	311	310
query72	6806	4795	4908	4795
query73	766	317	322	317
query74	6368	5923	5850	5850
query75	4916	3758	3632	3632
query76	4934	1143	1219	1143
query77	694	252	254	252
query78	13030	12126	11982	11982
query79	8554	655	641	641
query80	1580	390	387	387
query81	500	243	236	236
query82	1620	99	101	99
query83	173	134	136	134
query84	264	76	71	71
query85	894	322	329	322
query86	321	296	291	291
query87	3280	3030	3082	3030
query88	4659	2324	2307	2307
query89	497	313	288	288
query90	1916	215	218	215
query91	165	127	130	127
query92	60	55	52	52
query93	6462	588	613	588
query94	718	204	211	204
query95	2059	1948	2011	1948
query96	654	324	318	318
query97	6536	6430	6461	6430
query98	226	205	223	205
query99	3018	968	922	922
Total cold run time: 320353 ms
Total hot run time: 212463 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 30.6 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f5ca7a155bc4c28c9b0967b531fc8b4aaa0aa588, data reload: false

query1	0.03	0.03	0.03
query2	0.07	0.02	0.02
query3	0.25	0.04	0.04
query4	1.78	0.06	0.06
query5	0.53	0.53	0.53
query6	1.24	0.61	0.61
query7	0.01	0.01	0.01
query8	0.03	0.02	0.02
query9	0.53	0.47	0.47
query10	0.54	0.53	0.54
query11	0.13	0.09	0.09
query12	0.12	0.09	0.10
query13	0.62	0.62	0.62
query14	0.78	0.78	0.80
query15	0.78	0.76	0.76
query16	0.39	0.36	0.40
query17	1.00	1.04	1.01
query18	0.21	0.26	0.25
query19	1.89	1.85	1.88
query20	0.02	0.01	0.00
query21	15.45	0.54	0.55
query22	2.09	1.79	1.69
query23	16.96	1.05	0.89
query24	5.18	4.15	0.75
query25	0.39	0.10	0.04
query26	0.85	0.15	0.15
query27	0.05	0.04	0.03
query28	5.07	0.76	0.76
query29	12.66	2.28	2.40
query30	0.61	0.50	0.51
query31	2.81	0.37	0.38
query32	3.36	0.48	0.49
query33	3.11	3.07	3.06
query34	15.28	4.80	4.82
query35	4.89	4.88	4.86
query36	1.08	1.02	1.02
query37	0.07	0.04	0.04
query38	0.03	0.02	0.02
query39	0.02	0.02	0.01
query40	0.17	0.14	0.14
query41	0.07	0.01	0.02
query42	0.02	0.02	0.01
query43	0.02	0.02	0.02
Total cold run time: 101.19 s
Total hot run time: 30.6 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit f5ca7a155bc4c28c9b0967b531fc8b4aaa0aa588 with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.8 seconds inserted 10000000 Rows, about 458K ops/s

Copy link
Contributor

@lide-reed lide-reed left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions bot added the approved Indicates a PR has been approved by one committer. label Feb 8, 2025
Copy link
Contributor

github-actions bot commented Feb 8, 2025

PR approved by at least one committer and no changes requested.

Copy link
Contributor

github-actions bot commented Feb 8, 2025

PR approved by anyone and no changes requested.

@felixwluo
Copy link
Contributor Author

run p0

@felixwluo
Copy link
Contributor Author

run external

@felixwluo
Copy link
Contributor Author

run p0

@felixwluo
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 48916 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit f5ca7a155bc4c28c9b0967b531fc8b4aaa0aa588, data reload: false

------ Round 1 ----------------------------------
q1	17609	4349	4371	4349
q2	2082	158	152	152
q3	10531	1894	1945	1894
q4	10286	1267	1311	1267
q5	8510	3871	3879	3871
q6	232	121	124	121
q7	2011	1616	1612	1612
q8	9283	2724	2696	2696
q9	10359	9808	9740	9740
q10	8663	3530	3536	3530
q11	432	262	256	256
q12	470	304	306	304
q13	18350	3974	4067	3974
q14	349	326	331	326
q15	499	454	461	454
q16	546	457	453	453
q17	1127	945	917	917
q18	7339	6759	6970	6759
q19	1673	1520	1474	1474
q20	544	302	300	300
q21	4467	4116	4082	4082
q22	508	387	385	385
Total cold run time: 115870 ms
Total hot run time: 48916 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4323	4346	4291	4291
q2	325	225	226	225
q3	4175	4141	4160	4141
q4	2765	2737	2754	2737
q5	7160	7135	7118	7118
q6	239	120	119	119
q7	3265	2807	2813	2807
q8	4394	4436	4464	4436
q9	13709	13575	13601	13575
q10	4223	4265	4290	4265
q11	755	672	709	672
q12	1044	873	856	856
q13	6641	3774	3707	3707
q14	468	428	424	424
q15	508	453	448	448
q16	643	586	606	586
q17	3813	3884	3959	3884
q18	8851	8629	8823	8629
q19	1725	1664	1618	1618
q20	2356	2105	2072	2072
q21	8532	8522	8529	8522
q22	1031	924	914	914
Total cold run time: 80945 ms
Total hot run time: 76046 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 212089 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit f5ca7a155bc4c28c9b0967b531fc8b4aaa0aa588, data reload: false

query1	943	421	381	381
query2	6532	2183	2164	2164
query3	6923	199	201	199
query4	22904	21647	22388	21647
query5	19723	6466	6580	6466
query6	286	220	231	220
query7	4337	317	309	309
query8	245	251	230	230
query9	3086	2669	2604	2604
query10	475	320	287	287
query11	15828	14868	14824	14824
query12	134	78	74	74
query13	1039	441	445	441
query14	17163	13354	12938	12938
query15	394	223	231	223
query16	6477	286	268	268
query17	1932	939	906	906
query18	902	317	318	317
query19	217	155	152	152
query20	105	102	103	102
query21	191	99	98	98
query22	5214	5052	5027	5027
query23	34279	33433	33482	33433
query24	7700	6316	6280	6280
query25	530	425	441	425
query26	1271	164	159	159
query27	2273	304	292	292
query28	6128	2306	2273	2273
query29	2910	2782	2875	2782
query30	249	166	169	166
query31	985	721	740	721
query32	73	61	59	59
query33	468	261	261	261
query34	863	483	483	483
query35	1136	915	934	915
query36	1274	1159	1061	1061
query37	174	60	64	60
query38	3039	2928	2926	2926
query39	1362	1330	1323	1323
query40	306	99	97	97
query41	40	38	38	38
query42	85	84	83	83
query43	759	653	574	574
query44	1215	724	740	724
query45	245	231	229	229
query46	1241	965	964	964
query47	1968	1786	1675	1675
query48	516	422	419	419
query49	641	396	406	396
query50	881	645	626	626
query51	4820	4710	4726	4710
query52	93	92	91	91
query53	232	184	190	184
query54	2670	2467	2501	2467
query55	87	89	80	80
query56	224	218	213	213
query57	1213	1188	1197	1188
query58	221	212	214	212
query59	3415	3203	3268	3203
query60	229	221	212	212
query61	100	94	93	93
query62	841	516	478	478
query63	213	175	179	175
query64	3428	1581	1522	1522
query65	3631	3545	3535	3535
query66	770	414	434	414
query67	15760	15372	17019	15372
query68	9490	638	668	638
query69	502	255	274	255
query70	1501	1330	1417	1330
query71	420	306	309	306
query72	6658	4886	4896	4886
query73	760	319	321	319
query74	6413	5819	5782	5782
query75	5152	3625	3739	3625
query76	5244	1134	1218	1134
query77	913	247	262	247
query78	12479	11577	11858	11577
query79	8241	644	644	644
query80	1471	381	393	381
query81	494	238	238	238
query82	1630	100	95	95
query83	169	138	134	134
query84	262	68	72	68
query85	876	313	316	313
query86	328	331	294	294
query87	3222	3050	2999	2999
query88	4578	2311	2321	2311
query89	483	284	277	277
query90	1994	204	208	204
query91	170	127	128	127
query92	58	53	53	53
query93	6453	547	554	547
query94	725	214	210	210
query95	1994	1900	1930	1900
query96	646	335	326	326
query97	6480	6384	6415	6384
query98	227	205	214	205
query99	3004	819	810	810
Total cold run time: 318645 ms
Total hot run time: 212089 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.7 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit f5ca7a155bc4c28c9b0967b531fc8b4aaa0aa588, data reload: false

query1	0.03	0.02	0.03
query2	0.08	0.03	0.02
query3	0.24	0.04	0.04
query4	1.79	0.06	0.07
query5	0.54	0.53	0.52
query6	1.27	0.62	0.61
query7	0.02	0.01	0.00
query8	0.03	0.02	0.03
query9	0.53	0.50	0.47
query10	0.52	0.53	0.52
query11	0.12	0.08	0.08
query12	0.12	0.09	0.09
query13	0.63	0.61	0.61
query14	0.78	0.78	0.79
query15	0.77	0.77	0.76
query16	0.36	0.38	0.38
query17	1.01	1.01	1.00
query18	0.24	0.23	0.24
query19	1.96	1.81	1.88
query20	0.02	0.01	0.01
query21	15.45	0.56	0.54
query22	2.01	2.51	2.14
query23	17.30	1.09	0.95
query24	4.36	1.46	1.48
query25	0.39	0.14	0.05
query26	0.49	0.16	0.16
query27	0.05	0.04	0.04
query28	8.13	0.79	0.76
query29	12.64	2.41	2.33
query30	0.59	0.50	0.54
query31	2.82	0.39	0.38
query32	3.36	0.50	0.48
query33	3.07	3.11	3.01
query34	15.26	4.80	4.77
query35	4.85	4.85	4.84
query36	1.04	1.01	1.02
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.03	0.02	0.01
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.02	0.01
query43	0.03	0.01	0.01
Total cold run time: 103.27 s
Total hot run time: 31.7 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit f5ca7a155bc4c28c9b0967b531fc8b4aaa0aa588 with default session variables
Stream load json:         19 seconds loaded 2358488459 Bytes, about 118 MB/s
Stream load orc:          57 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      32 seconds loaded 861443392 Bytes, about 25 MB/s
Insert into select:       21.9 seconds inserted 10000000 Rows, about 456K ops/s

@felixwluo
Copy link
Contributor Author

run buildall

@doris-robot
Copy link

TPC-H: Total hot run time: 49082 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit a581b10dcac3ec9837d75b2728af153a230fb51d, data reload: false

------ Round 1 ----------------------------------
q1	17726	4357	4383	4357
q2	2061	158	155	155
q3	10444	1896	1934	1896
q4	10314	1225	1334	1225
q5	8581	3895	3914	3895
q6	234	124	126	124
q7	1989	1618	1620	1618
q8	9306	2726	2685	2685
q9	10504	10069	9924	9924
q10	8652	3534	3490	3490
q11	424	252	247	247
q12	472	300	304	300
q13	18383	3968	4029	3968
q14	355	328	325	325
q15	513	475	460	460
q16	543	454	459	454
q17	1127	966	917	917
q18	7317	6788	6773	6773
q19	1673	1500	1505	1500
q20	521	291	303	291
q21	4400	4082	4083	4082
q22	492	400	396	396
Total cold run time: 116031 ms
Total hot run time: 49082 ms

----- Round 2, with runtime_filter_mode=off -----
q1	4360	4309	4310	4309
q2	324	224	225	224
q3	4126	4129	4135	4129
q4	2761	2727	2741	2727
q5	7229	7190	7137	7137
q6	238	118	120	118
q7	3259	2809	2814	2809
q8	4381	4502	4496	4496
q9	14099	13915	13816	13816
q10	4232	4258	4227	4227
q11	758	690	690	690
q12	1039	835	876	835
q13	6857	3741	3768	3741
q14	441	430	428	428
q15	507	459	457	457
q16	621	585	593	585
q17	3815	3894	3818	3818
q18	8725	8763	8821	8763
q19	1707	1663	1626	1626
q20	2371	2127	2083	2083
q21	8396	8441	8400	8400
q22	1015	975	914	914
Total cold run time: 81261 ms
Total hot run time: 76332 ms

@doris-robot
Copy link

TPC-DS: Total hot run time: 213220 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit a581b10dcac3ec9837d75b2728af153a230fb51d, data reload: false

query1	936	420	383	383
query2	6539	2158	2032	2032
query3	6925	202	201	201
query4	22985	21747	22013	21747
query5	19734	6501	6490	6490
query6	282	219	250	219
query7	4333	305	309	305
query8	274	258	247	247
query9	3123	2660	2601	2601
query10	478	315	316	315
query11	15578	14879	14926	14879
query12	134	79	76	76
query13	1027	451	442	442
query14	17397	13262	13295	13262
query15	367	224	232	224
query16	6486	291	272	272
query17	1918	937	914	914
query18	891	319	311	311
query19	217	163	153	153
query20	108	98	98	98
query21	187	103	92	92
query22	5065	5065	5045	5045
query23	34359	33467	33530	33467
query24	7909	6293	6315	6293
query25	535	448	439	439
query26	1272	168	164	164
query27	2400	306	302	302
query28	6089	2297	2253	2253
query29	2909	2799	2692	2692
query30	241	171	164	164
query31	946	783	747	747
query32	73	65	63	63
query33	457	271	255	255
query34	841	500	495	495
query35	1151	947	931	931
query36	1227	1157	1206	1157
query37	181	62	62	62
query38	3059	2936	2917	2917
query39	1361	1342	1335	1335
query40	309	101	98	98
query41	42	38	39	38
query42	92	88	85	85
query43	670	586	571	571
query44	1144	702	713	702
query45	246	234	231	231
query46	1223	965	969	965
query47	2000	1736	1766	1736
query48	516	419	407	407
query49	652	380	390	380
query50	860	634	625	625
query51	4790	4762	4664	4664
query52	99	77	89	77
query53	226	183	202	183
query54	2661	2485	2518	2485
query55	91	85	84	84
query56	236	205	226	205
query57	1321	1224	1179	1179
query58	229	228	213	213
query59	3410	3239	3221	3221
query60	231	213	199	199
query61	99	95	119	95
query62	827	492	480	480
query63	204	182	174	174
query64	3585	1596	1488	1488
query65	3624	3539	3543	3539
query66	770	437	383	383
query67	15587	15495	15485	15485
query68	9916	662	657	657
query69	507	286	287	286
query70	1534	1475	1587	1475
query71	426	314	319	314
query72	7027	4783	4856	4783
query73	761	325	318	318
query74	6308	5816	5836	5816
query75	5312	3820	3696	3696
query76	5640	1120	1203	1120
query77	928	263	267	263
query78	12713	11724	11702	11702
query79	8128	637	653	637
query80	1774	412	402	402
query81	492	249	239	239
query82	1629	109	101	101
query83	176	141	147	141
query84	266	71	70	70
query85	897	324	329	324
query86	333	333	295	295
query87	3246	3004	3075	3004
query88	4584	2308	2312	2308
query89	487	309	269	269
query90	1974	220	219	219
query91	167	142	130	130
query92	64	55	56	55
query93	6738	575	550	550
query94	705	211	210	210
query95	2087	1961	1976	1961
query96	670	328	339	328
query97	6555	6436	6490	6436
query98	250	204	202	202
query99	2995	912	873	873
Total cold run time: 321027 ms
Total hot run time: 213220 ms

@doris-robot
Copy link

ClickBench: Total hot run time: 31.22 s
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/clickbench-tools
ClickBench test result on commit a581b10dcac3ec9837d75b2728af153a230fb51d, data reload: false

query1	0.03	0.02	0.02
query2	0.08	0.02	0.02
query3	0.26	0.03	0.05
query4	1.77	0.06	0.07
query5	0.53	0.53	0.52
query6	1.26	0.63	0.61
query7	0.02	0.01	0.01
query8	0.03	0.03	0.02
query9	0.51	0.50	0.48
query10	0.55	0.54	0.55
query11	0.13	0.09	0.09
query12	0.11	0.09	0.09
query13	0.62	0.61	0.61
query14	0.78	0.78	0.81
query15	0.80	0.76	0.76
query16	0.36	0.36	0.34
query17	1.01	1.00	1.01
query18	0.24	0.24	0.23
query19	1.90	1.86	1.85
query20	0.02	0.01	0.01
query21	15.44	0.56	0.55
query22	2.34	2.76	2.41
query23	17.10	1.09	0.85
query24	5.54	0.71	0.91
query25	0.38	0.09	0.05
query26	0.53	0.15	0.15
query27	0.04	0.04	0.03
query28	7.88	0.76	0.71
query29	12.64	2.40	2.38
query30	0.61	0.52	0.53
query31	2.80	0.38	0.37
query32	3.38	0.50	0.50
query33	3.07	2.99	3.11
query34	15.25	4.82	4.80
query35	4.88	4.88	4.85
query36	1.06	1.01	1.02
query37	0.06	0.05	0.05
query38	0.03	0.02	0.02
query39	0.02	0.02	0.02
query40	0.16	0.14	0.14
query41	0.07	0.01	0.01
query42	0.02	0.01	0.02
query43	0.02	0.02	0.02
Total cold run time: 104.33 s
Total hot run time: 31.22 s

@doris-robot
Copy link

Load test result on machine: 'aliyun_ecs.c7a.8xlarge_32C64G'

Load test result on commit a581b10dcac3ec9837d75b2728af153a230fb51d with default session variables
Stream load json:         20 seconds loaded 2358488459 Bytes, about 112 MB/s
Stream load orc:          58 seconds loaded 1101869774 Bytes, about 18 MB/s
Stream load parquet:      31 seconds loaded 861443392 Bytes, about 26 MB/s
Insert into select:       22.1 seconds inserted 10000000 Rows, about 452K ops/s

@cambyzju cambyzju merged commit bef4651 into apache:branch-2.0 Feb 10, 2025
21 of 23 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by one committer. reviewed
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants