Skip to content

[fix](delete) normalize DeleteSubPredicatePB operator on read path#62052

Open
felixwluo wants to merge 2 commits intoapache:masterfrom
felixwluo:fix-0402
Open

[fix](delete) normalize DeleteSubPredicatePB operator on read path#62052
felixwluo wants to merge 2 commits intoapache:masterfrom
felixwluo:fix-0402

Conversation

@felixwluo
Copy link
Copy Markdown
Member

What problem does this PR solve?

Issue Number: close #xxx

Related PR: #xxx

Problem Summary:

Release note

None

Check List (For Author)

  • Test

    • Regression test
    • Unit Test
    • Manual test (add detailed scripts or steps below)
    • No need to test or manual test. Explain why:
      • This is a refactor/code format and no logic has been changed.
      • Previous test can cover this change.
      • No code files have been changed.
      • Other reason
  • Behavior changed:

    • No.
    • Yes.
  • Does this need documentation?

    • No.
    • Yes.

Check List (For Reviewer who merge this PR)

  • Confirm the release note
  • Confirm test cases
  • Confirm document
  • Add branch pick label

@hello-stephen
Copy link
Copy Markdown
Contributor

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

@felixwluo
Copy link
Copy Markdown
Member Author

run buildall

@doris-robot
Copy link
Copy Markdown

TPC-H: Total hot run time: 29340 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpch-tools
Tpch sf100 test result on commit 0d82ee95c41e6080c3dfef5d232e45fa4355369f, data reload: false

------ Round 1 ----------------------------------
orders	Doris	NULL	NULL	0	0	0	NULL	0	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL	
============================================
q1	17679	3920	3802	3802
q2	q3	10725	858	598	598
q4	4676	468	361	361
q5	7462	1339	1158	1158
q6	189	170	137	137
q7	914	940	774	774
q8	9310	1428	1297	1297
q9	5474	5329	5271	5271
q10	6316	2027	1753	1753
q11	490	271	286	271
q12	869	697	522	522
q13	18058	2767	2169	2169
q14	286	279	260	260
q15	q16	901	867	782	782
q17	915	1161	838	838
q18	6348	5569	5507	5507
q19	1307	1265	1093	1093
q20	615	585	412	412
q21	4923	2431	1981	1981
q22	482	413	354	354
Total cold run time: 97939 ms
Total hot run time: 29340 ms

----- Round 2, with runtime_filter_mode=off -----
orders	Doris	NULL	NULL	150000000	42	6422171781	NULL	22778155	NULL	NULL	2023-12-26 18:27:23	2023-12-26 18:42:55	NULL	utf-8	NULL	NULL	
============================================
q1	4620	4464	4591	4464
q2	q3	4630	4703	4101	4101
q4	2036	2088	1325	1325
q5	4898	5027	5133	5027
q6	197	180	143	143
q7	2003	1758	1643	1643
q8	3334	3042	3031	3031
q9	8195	8232	8194	8194
q10	4470	4444	4231	4231
q11	581	422	403	403
q12	682	733	515	515
q13	2849	3182	2392	2392
q14	285	313	272	272
q15	q16	769	773	679	679
q17	1331	1327	1183	1183
q18	7906	6843	6956	6843
q19	1170	1136	1144	1136
q20	2235	2227	1942	1942
q21	6085	5537	4753	4753
q22	533	536	412	412
Total cold run time: 58809 ms
Total hot run time: 52689 ms

@doris-robot
Copy link
Copy Markdown

TPC-DS: Total hot run time: 180058 ms
machine: 'aliyun_ecs.c7a.8xlarge_32C64G'
scripts: https://github.com/apache/doris/tree/master/tools/tpcds-tools
TPC-DS sf100 test result on commit 0d82ee95c41e6080c3dfef5d232e45fa4355369f, data reload: false

query5	4350	641	523	523
query6	332	241	220	220
query7	4281	613	345	345
query8	342	237	221	221
query9	8744	3933	3888	3888
query10	464	411	353	353
query11	6679	5495	5129	5129
query12	212	141	130	130
query13	1287	643	438	438
query14	5689	5167	4764	4764
query14_1	4167	4127	4123	4123
query15	214	205	187	187
query16	1023	470	434	434
query17	1167	793	661	661
query18	2711	517	389	389
query19	260	233	195	195
query20	148	133	130	130
query21	222	149	119	119
query22	14926	14714	14364	14364
query23	18259	17342	16673	16673
query23_1	17040	16823	16849	16823
query24	7455	1765	1361	1361
query24_1	1359	1358	1371	1358
query25	661	490	427	427
query26	1254	335	178	178
query27	2621	653	389	389
query28	4388	1918	1874	1874
query29	950	677	564	564
query30	299	232	191	191
query31	1091	1039	955	955
query32	84	69	69	69
query33	532	353	297	297
query34	1184	1157	690	690
query35	760	774	652	652
query36	1205	1213	1105	1105
query37	155	102	88	88
query38	3099	3040	2968	2968
query39	908	899	863	863
query39_1	846	823	830	823
query40	235	160	140	140
query41	64	64	61	61
query42	276	270	269	269
query43	316	318	281	281
query44	
query45	203	202	189	189
query46	1130	1296	799	799
query47	2328	2315	2203	2203
query48	412	426	295	295
query49	637	520	434	434
query50	737	284	225	225
query51	4306	4271	4199	4199
query52	281	281	266	266
query53	329	350	274	274
query54	323	281	275	275
query55	100	93	89	89
query56	320	338	323	323
query57	1750	1601	1645	1601
query58	294	274	275	274
query59	2903	2975	2736	2736
query60	333	340	359	340
query61	163	160	159	159
query62	672	615	570	570
query63	316	283	271	271
query64	5187	1430	1053	1053
query65	
query66	1399	470	367	367
query67	24267	24232	24292	24232
query68	
query69	460	356	308	308
query70	1028	1004	1018	1004
query71	375	334	328	328
query72	3004	2747	2505	2505
query73	826	788	445	445
query74	9817	9773	9533	9533
query75	3553	3402	2994	2994
query76	2332	1120	789	789
query77	397	415	343	343
query78	11302	11320	10742	10742
query79	3050	1073	827	827
query80	1749	755	671	671
query81	535	277	234	234
query82	922	161	124	124
query83	333	292	263	263
query84	266	151	124	124
query85	968	547	463	463
query86	455	339	316	316
query87	3339	3229	3097	3097
query88	3631	2700	2684	2684
query89	481	411	381	381
query90	1887	185	178	178
query91	179	174	146	146
query92	81	71	75	71
query93	1253	903	509	509
query94	696	328	308	308
query95	673	356	332	332
query96	1048	766	341	341
query97	2716	2682	2568	2568
query98	247	227	225	225
query99	1097	1081	951	951
Total cold run time: 262453 ms
Total hot run time: 180058 ms

@felixwluo
Copy link
Copy Markdown
Member Author

run beut

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants