单测目录迁移-ISSUES #51853

tianshuo78520a · 2023-03-20T06:25:05Z

问题描述 Please describe your issue Alternatives

大家好，近期我们在重新整理Paddle框架中所有测试文件，希望把所有单测整合到test目录下，让单测目录变的清晰，方便大家进行代码测试。我们一共统计了62个单测目录，需要进行迁移，欢迎大家提交PR一起整理单测目录。

为了修改单测目录，你需要做的是:

下载 Paddle 代码，进行任务目录下文件迁移工作：
a. 创建新路径目录，把现路径下的所有文件进行迁移，迁移到新目录下。（现路径下不需要保留）
b. 修改新路径下的 CMakeLists.txt 文件，保证单测文件不会丢失
参考《Paddle贡献指南》进行本地验证（编译、执行单测，本地可以先进行迁移部分单测验证），成功后可以提交代码

注:

你可以参考：Mv phi and fluid/test To test dir 进行单测目录迁移，迁移工作难度不大，还可以熟悉cmake写法和paddle单测逻辑。
该任务时间：PR 截止提交时间是3月31日，截止合入时间是4月3日
认领规则：直接回复下 issue 下方
PR通过CI后，可以评论里或者 review request @tianshuo78520a @zhiqiu ，研发会进行审核
历史上的 good first issue 列表，也欢迎来提 PR 解决~ 欢迎联系花花加入社区，和我们一起快乐开源！

待迁移单测目录列表：（59/63）

按 merge 的时间顺序，排名不分先后： @tianshuo78520a (17) @Zheng-Bicheng (23) @jjyaoao (2) @KimBioInfoStudio (2) @Ainavo (2) @gouzil (6) @jinyouzhi (1) @Liyulingyue (1) @Happyd99 (1) @Xingkai98 (1) @RedContritio (2)

序号	新路径	认领人	修复PR	现路径
1	test/quantization✅(2023/4/1)	@Liyulingyue	#52353	python/paddle/static/quantization/tests
2	test/legacy_test✅(2023/3/22)	@Zheng-Bicheng	#51941	python/paddle/tests
3	test/quantization✅(2023/3/25)	@Zheng-Bicheng	#51942	python/paddle/tests/quantization
4	test/legacy_test ✅(2023/3/23)	@Zheng-Bicheng	#51943	python/paddle/reader/tests
5	test/legacy_test ✅(2023/3/24)	@Zheng-Bicheng	#51944	python/paddle/fluid/tests
6	test/book✅(2023/3/24)	@Zheng-Bicheng	#51945	python/paddle/fluid/tests/book
7	test/custom_kernel ✅(2023/3/24)	@Zheng-Bicheng	#51946	python/paddle/fluid/tests/custom_kernel/*.py
8	test/custom_op✅(2023/3/28)	@Zheng-Bicheng	#51948	python/paddle/fluid/tests/custom_op/*.py
9	test/custom_runtime✅(2023/3/29)	@Zheng-Bicheng	#52021	python/paddle/fluid/tests/custom_runtime/*.py
10	test/legacy_test ✅(2023/6/1)	@tianshuo78520a	#53235	python/paddle/fluid/tests/unittests
11	test/collective ✅(2023/6/1)	@tianshuo78520a	#53235	python/paddle/fluid/tests/unittests/collective
12	test/collective/fleet ✅(2023/6/1)	@tianshuo78520a	#53235	python/paddle/fluid/tests/unittests/collective/fleet
13	test/collective/multinode ✅(2023/3/28)	@Ainavo	#51982	python/paddle/fluid/tests/unittests/collective/multinode
14	test/sequence ✅(2023/4/19)	@tianshuo78520a	#52985	python/paddle/fluid/tests/unittests/sequence
15	删除✅(2023/3/29)	@Zheng-Bicheng	#52022	python/paddle/fluid/tests/unittests/npu
16	test/fft ✅(2023/4/10)	@Xingkai98	#52634	python/paddle/fluid/tests/unittests/fft
17	test/auto_parallel ✅(2023/4/17)	@tianshuo78520a	#52885	python/paddle/fluid/tests/unittests/auto_parallel
18	test/rnn ✅(2023/4/17)	@liulinduo	#52513	python/paddle/fluid/tests/unittests/rnn
19	test/distribution ✅(2023/4/17)	@tianshuo78520a	#52885	python/paddle/fluid/tests/unittests/distribution
20	test/rpc ✅(2023/3/28)	@Zheng-Bicheng	#52166	python/paddle/fluid/tests/unittests/rpc
21	test/prim ✅(2023/3/30)	@Zheng-Bicheng	#52167	python/paddle/fluid/tests/unittests/prim
22	test/prim/model ✅(2023/3/30)	@Zheng-Bicheng	#52167	python/paddle/fluid/tests/unittests/prim/model
23	test/prim/prim ✅(2023/3/30)	@Zheng-Bicheng	#52167	python/paddle/fluid/tests/unittests/prim/prim
24	test/prim/prim ✅(2023/3/30)	@Zheng-Bicheng	#52167	python/paddle/fluid/tests/unittests/prim/prim/vjp
25	test/prim/prim/vjp/static ✅(2023/3/30)	@Zheng-Bicheng	#52167	python/paddle/fluid/tests/unittests/prim/prim/vjp/static
26	test/prim/prim/vjp/eager ✅(2023/3/30)	@Zheng-Bicheng	#52167	python/paddle/fluid/tests/unittests/prim/prim/vjp/eager
27	test/prim/prim/flags ✅(2023/3/30)	@Zheng-Bicheng	#52167	python/paddle/fluid/tests/unittests/prim/prim/flags
28	test/mkldnn ✅(2023/3/31)	@jinyouzhi	#51911	python/paddle/fluid/tests/unittests/mkldnn
29	test/dygraph_to_static ✅(2023/3/31)	@Ainavo	#52069	python/paddle/fluid/tests/unittests/dygraph_to_static
30	test/ir ✅(2023/4/17)	@tianshuo78520a	#52834	python/paddle/fluid/tests/unittests/ir
31	test/ir/inference ✅(2023/4/17)	@tianshuo78520a	#52834	python/paddle/fluid/tests/unittests/ir/inference
32	test/white_list	@Zheng-Bicheng	#52129	python/paddle/fluid/tests/unittests/white_list
33	test/ps ✅(2023/4/11)	@tianshuo78520a	#52885	python/paddle/fluid/tests/unittests/ps
34	test/tokenizer ✅(2023/4/11)	@RedContritio	#52658	python/paddle/fluid/tests/unittests/tokenizer
35	test/xpu ✅(2023/4/12)	@RedContritio	#52661	python/paddle/fluid/tests/unittests/xpu
36	test/standalone_executor✅(2023/4/7)	@Happyd99	#52520	python/paddle/fluid/tests/unittests/standalone_executor
37	test/ipu ✅(2023/3/30)	@gouzil	#52143	python/paddle/fluid/tests/unittests/ipu
38	test/ipu/custom_ops ✅(2023/3/30)	@gouzil	#52143	python/paddle/fluid/tests/unittests/ipu/custom_ops
39	test/ipu/custom_ops/deprecated ✅(2023/3/30)	@gouzil	#52143	python/paddle/fluid/tests/unittests/ipu/custom_ops/deprecated
40	test/ipu/distributed✅(2023/3/30)	@gouzil	#52143	python/paddle/fluid/tests/unittests/ipu/distributed
41	test/asp ✅(2023/3/29)	@gouzil	#52141	python/paddle/fluid/tests/unittests/asp
42	test/distributed_passes ✅(2023/4/11)	@tianshuo78520a	#52885	python/paddle/fluid/tests/unittests/distributed_passes
43	删除✅(2023/3/25)	@jjyaoao	#52064, #52291	python/paddle/fluid/tests/unittests/mlu
44	test/prim/composite_ops ✅(2023/3/30)	@Zheng-Bicheng	#52167	python/paddle/fluid/tests/unittests/prim/composite_ops
45	test/autograd ✅(2023/3/28)	@gouzil	#52142	python/paddle/fluid/tests/unittests/autograd
46	test/contrib ✅(2023/3/28)	@Zheng-Bicheng	#52168	paddle/fluid/contrib/tests
47	删除 ✅(2023/3/29)	@Zheng-Bicheng	#52169	python/paddle/fluid/incubate/fleet
48	test/dataset✅(2023/3/28)	@KimBioInfoStudio	#52148	python/paddle/dataset/tests
49	test/cpp/phi/api ✅(2023/3/20)	@tianshuo78520a	#50640	paddle/phi/tests/api
50	test/cpp/phi/common ✅(2023/3/20)	@tianshuo78520a	#50640	paddle/phi/tests/common
51	test/cpp/phi/core ✅(2023/3/20)	@tianshuo78520a	#50640	paddle/phi/tests/core
52	test/cpp/phi/kernels ✅(2023/3/20)	@tianshuo78520a	#50640	paddle/phi/tests/kernels
53	test/cpp/phi/ops ✅(2023/3/20)	@tianshuo78520a	#50640	paddle/phi/tests/ops
54	删除 ✅(2023/3/29)	@jjyaoao	#52063	paddle/infrt/tests
55	test/cpp/imperative ✅(2023/3/29)	@Zheng-Bicheng	#52170	paddle/fluid/imperative/tests
56	test/cpp/prim✅(2023/3/30)	@Zheng-Bicheng	#52173	paddle/fluid/prim/tests
57	test/xpu/cpp✅(2023/3/30)	@KimBioInfoStudio	#52243	paddle/fluid/platform/device/xpu/tests
58	test/cpp/inference/api ✅(2023/4/21)	@tianshuo78520a	#52987	paddle/fluid/inference/tests/api
59	test/cpp/inference/infer_ut ✅(2023/4/21)	@tianshuo78520a	#52987	paddle/fluid/inference/tests/infer_ut
60	test/cpp/eager/data_structure_tests ✅(2023/4/24)	@tianshuo78520a	#53167	paddle/fluid/eager/tests/data_structure_tests
61	test/cpp/eager/performance_tests ✅(2023/4/24)	@tianshuo78520a	#53167	paddle/fluid/eager/tests/performance_tests
62	test/cpp/eager/task_tests ✅(2023/4/24)	@tianshuo78520a	#53167	paddle/fluid/eager/tests/task_tests
63	test/prim/process ✅(2023/3/30)	@Zheng-Bicheng	#52167	python/paddle/fluid/tests/unittests/prim/process

其他成果总结

子任务	作者	相关PR
预先设置单测目录，避免频繁冲突 ✅(2023/3/26)	@Zheng-Bicheng	#52131 #52152
test/cpp/fluid #52782 (comment)	@gouzil	#53426✅ #53429✅ #53434✅ #53443✅ #53446✅ #53448✅ #53458✅ #53460✅ #53472✅ #53470✅

Liyulingyue · 2023-03-20T23:07:35Z

序号	新路径	认领人	修复PR	现路径
1	test/quantization	Liyulingyue	#51890	python/paddle/static/quantization/tests

Ainavo · 2023-03-21T01:38:16Z

序号	新路径	认领人	修复pr	现路径
29	test/dygraph_to_static	@Ainavo	#52069	python/paddle/fluid/tests/unittests/dygraph_to_static

jinyouzhi · 2023-03-21T08:41:00Z

序号	新路径	认领人	修复pr	现路径
28	test/mkldnn	@jinyouzhi	#51911	python/paddle/fluid/tests/unittests/mkldnn

Zheng-Bicheng · 2023-03-21T11:21:40Z

序号	新路径	认领人	修复PR	现路径
2	test/legacy_test	Zheng-Bicheng	#51941	python/paddle/tests

@tianshuo78520a @luotao1 ，大佬们，2已经合入了哦，帮忙改一下榜单呗🫡

Zheng-Bicheng · 2023-03-21T15:39:15Z

序号	新路径	认领人	修复PR	现路径
3	test/quantization	Zheng-Bicheng	#51942	python/paddle/tests/quantization

Zheng-Bicheng · 2023-03-21T15:48:02Z

序号	新路径	认领人	修复PR	现路径
4	test/legacy_test	Zheng-Bicheng	#51943	python/paddle/reader/tests

Zheng-Bicheng · 2023-03-21T16:00:56Z

序号	新路径	认领人	修复PR	现路径
5	test/legacy_test	Zheng-Bicheng	#51944	python/paddle/fluid/tests
6	test/book	Zheng-Bicheng	#51945	python/paddle/fluid/tests/book
7	test/custom_kernel	Zheng-Bicheng	#51946	python/paddle/fluid/tests/custom_kernel/*.py
8	test/custom_op	Zheng-Bicheng	#51948	python/paddle/fluid/tests/custom_op/*.py

Ainavo · 2023-03-22T07:22:57Z

序号	新路径	认领人	修复pr	现路径
11	test/collective			python/paddle/fluid/tests/unittests/collective
12	test/collective/feet			python/paddle/fluid/tests/unittests/collective/feet
13	test/collective/multinode	@Ainavo	#51982	python/paddle/fluid/tests/unittests/collective/multinode

co63oc · 2023-03-22T07:35:31Z

序号	新路径	认领人	修复PR	现路径
30	test/ir	@co63oc	关闭PR	python/paddle/fluid/tests/unittests/ir
31	test/ir/inference	@co63oc	关闭PR	python/paddle/fluid/tests/unittests/ir/inference

develop更新较多，合并分支CI较多时间，关闭PR
迁移主要修改
CMakeLists.txt 修改目录配置
py_test_modules 函数迁移

Zheng-Bicheng · 2023-03-23T03:31:07Z

序号	新路径	认领人	修复PR	现路径
9	test/custom_runtime	Zheng-Bicheng	#52021	python/paddle/fluid/tests/custom_runtime/*.py
10	test/legacy_test	Zheng-Bicheng		python/paddle/fluid/tests/unittests
15	删除	Zheng-Bicheng	#52022	python/paddle/fluid/tests/unittests/npu
14	test/sequence	Zheng-Bicheng	#52023	python/paddle/fluid/tests/unittests/sequence

luotao1 · 2023-03-23T03:56:54Z

@tianshuo78520a @luotao1 ，大佬们，2已经合入了哦，帮忙改一下榜单呗🫡

@Zheng-Bicheng 榜单会不定时更新，BTW，在原来的评论里修改内容，我们会收不到邮件提醒

tianshuo78520a · 2023-03-31T02:07:14Z

<

序号新路径认领人现路径
33 test/ps python/paddle/fluid/tests/unittests/ps
34 test/tokenizer python/paddle/fluid/tests/unittests/tokenizer
35 test/xpu python/paddle/fluid/tests/unittests/xpu
36 test/standalone_executor python/paddle/fluid/tests/unittests/standalone_executor

请问是否已经提PR？

qili93 · 2023-03-31T02:10:40Z

@tianshuo78520a this test mv will block PaddleCustomDevice next submodule uplift cc: @luotao1 @zhiqiu @ronny1996 @qili93

Hi Kim,
PaddleCustomDevice only depends on op_test.py and if you do not update the submodule of Paddle then there will be no impact to PaddleCustomDevice. Please kindly help to let me know which problem you met and propose to fix it in PaddleCustomDevice repo :)
Thanks Qi

Thx for ur reply, Chi

What do u guys think about mv all test base class to wheel like PyTorch do? Then we do not need symlink TestBaseClass in PaddleCustomDevice, my concern is that with growing of PaddleCustomDevice, symlink will growing as well.

Thx Kim

Hi Kim,

That's exactly what we are doing now :)

And I think there is already an issue opened for this, @luotao1 please help to comment the issue if we already have, thanks!

tianshuo78520a · 2023-04-07T06:44:17Z

序号新路径认领人修复PR 现路径
30 test/ir @co63oc 关闭PR python/paddle/fluid/tests/unittests/ir
31 test/ir/inference @co63oc 关闭PR python/paddle/fluid/tests/unittests/ir/inference
develop更新较多，合并分支CI较多时间，关闭PR 迁移主要修改 CMakeLists.txt 修改目录配置 py_test_modules 函数迁移

@co63oc 请问还要认领么？

RedContritio · 2023-04-07T06:55:01Z

序号	新路径	认领人	修复PR	现路径
34	test/tokenizer	@RedContritio	#52658	python/paddle/fluid/tests/unittests/tokenizer
35	test/xpu	@RedContritio	#52661	python/paddle/fluid/tests/unittests/xpu

Xingkai98 · 2023-04-07T07:16:34Z

序号	新路径	认领人	修复PR	现路径
16	test/fft	@Xingkai98	#52634	python/paddle/fluid/tests/unittests/fft

tipHkB5n · 2023-04-07T07:37:22Z

序号	新路径	认领人	修复PR	现路径
17	test/auto_parallel	@tipHkB5n	#52635	python/paddle/fluid/tests/unittests/auto_parallel

ccsuzzh · 2023-04-07T14:45:47Z

序号	新路径	认领人	修复PR	现路径
33	test/ps	@ccsuzzh	#52689	python/paddle/fluid/tests/unittests/ps

luotao1 · 2023-05-25T07:57:30Z

感谢所有参与的10位小伙伴，这个任务已经基本做完了，收尾工作由 @tianshuo78520a 完成：

按 merge 的时间顺序，排名不分先后： @Zheng-Bicheng (23) @jjyaoao (2) @KimBioInfoStudio (2) @Ainavo (2) @gouzil (6) @jinyouzhi (1) @Liyulingyue (1) @Happyd99 (1) @Xingkai98 (1) @RedContritio (2)

欢迎大家继续关注飞桨快乐开源活动，我们近期会发布新的任务，谢谢大家！

tianshuo78520a added status/new-issue 新建 type/feature-request 新需求申请 labels Mar 20, 2023

luotao1 assigned luotao1, zhiqiu and tianshuo78520a Mar 20, 2023

luotao1 added this to Call for Contributions Mar 20, 2023

luotao1 moved this to In Progress in Call for Contributions Mar 20, 2023

luotao1 mentioned this issue Mar 20, 2023

🎁飞桨快乐开源活动表单 #48019

Closed

luotao1 added the good first issue label Mar 20, 2023

Liyulingyue mentioned this issue Mar 20, 2023

[Test Mv] quantization #51890

Closed

jinyouzhi mentioned this issue Mar 21, 2023

[Test Mv] move mkldnn unittests to test dir #51911

Merged

paddle-bot bot added type/others 其他问题 status/close 已关闭 labels Mar 21, 2023

This was referenced Mar 21, 2023

[Test Mv] legacy_test #51941

Merged

[Test Mv] quantization #51942

Merged

Zheng-Bicheng mentioned this issue Mar 21, 2023

[Test Mv] reader to legacy_test #51943

Merged

This was referenced Mar 22, 2023

[Test Mv] move dygraph_to_static to test dir #51981

Closed

[Test Mv] move collective/multinode to test dir #51982

Merged

[Test Mv] Move collective/fleet to test dir #51987

Closed

Ainavo mentioned this issue Mar 31, 2023

[Test Mv] move dygraph_to_static to test dir #52069

Merged

Happyd99 mentioned this issue Apr 4, 2023

[Test MV] standalone_executor #52520

Merged

kendaji12138 mentioned this issue Apr 6, 2023

[Test MV] distribution #52575

Closed

Xingkai98 mentioned this issue Apr 7, 2023

[Test MV] fft #52634

Merged

tipHkB5n mentioned this issue Apr 7, 2023

[Test MV] auto_parallel #52635

Closed

RedContritio mentioned this issue Apr 7, 2023

[Move Test] Tokenizer #52658

Merged

RedContritio mentioned this issue Apr 7, 2023

[Move Test] xpu #52661

Merged

jjyaoao mentioned this issue Apr 8, 2023

remove infrt V1.1 #52672

Merged

ccsuzzh mentioned this issue Apr 8, 2023

[Test Mv] ps #52689

Closed

Ainavo mentioned this issue Apr 9, 2023

[Test Mv] Move collective/fleet to test dir #52068

Closed

jjyaoao mentioned this issue Apr 10, 2023

remove paddle/infrt/ #52719

Merged

zhangbo9674 mentioned this issue Apr 13, 2023

[IR] Move paddle_ir_test to test_ir #52877

Merged

liulinduo mentioned this issue Apr 16, 2023

[Test Mv] remove rnn #52967

Merged

This was referenced Apr 17, 2023

[Test MV] auto_parallel #52973

Closed

[Test MV] auto_parallel #52974

Closed

kendaji12138 mentioned this issue Apr 19, 2023

Test/cpp/eager/task tests #53102

Closed

luotao1 moved this from Done to In Progress in Call for Contributions Apr 28, 2023

luotao1 closed this as completed May 25, 2023

github-project-automation bot moved this from In Progress to Done in Call for Contributions May 25, 2023

paddle-bot bot added status/close 已关闭 and removed status/reopen 重新打开 labels May 25, 2023

SigureMo mentioned this issue Aug 26, 2023

【Docathon】替换文档中的 tests/unittests 单测路径为新路径 PaddlePaddle/docs#6140

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

单测目录迁移-ISSUES #51853

单测目录迁移-ISSUES #51853

tianshuo78520a commented Mar 20, 2023 •

edited

Loading

Liyulingyue commented Mar 20, 2023 •

edited

Loading

Ainavo commented Mar 21, 2023 •

edited

Loading

jinyouzhi commented Mar 21, 2023

Zheng-Bicheng commented Mar 21, 2023 •

edited

Loading

Zheng-Bicheng commented Mar 21, 2023 •

edited

Loading

Zheng-Bicheng commented Mar 21, 2023 •

edited

Loading

Zheng-Bicheng commented Mar 21, 2023 •

edited

Loading

Ainavo commented Mar 22, 2023 •

edited

Loading

co63oc commented Mar 22, 2023 •

edited

Loading

Zheng-Bicheng commented Mar 23, 2023 •

edited

Loading

luotao1 commented Mar 23, 2023

tianshuo78520a commented Mar 31, 2023

qili93 commented Mar 31, 2023

tianshuo78520a commented Apr 7, 2023

RedContritio commented Apr 7, 2023 •

edited

Loading

Xingkai98 commented Apr 7, 2023

tipHkB5n commented Apr 7, 2023

ccsuzzh commented Apr 7, 2023 •

edited

Loading

luotao1 commented May 25, 2023

单测目录迁移-ISSUES #51853

单测目录迁移-ISSUES #51853

Comments

tianshuo78520a commented Mar 20, 2023 • edited Loading

问题描述 Please describe your issue Alternatives

其他成果总结

Liyulingyue commented Mar 20, 2023 • edited Loading

Ainavo commented Mar 21, 2023 • edited Loading

jinyouzhi commented Mar 21, 2023

Zheng-Bicheng commented Mar 21, 2023 • edited Loading

Zheng-Bicheng commented Mar 21, 2023 • edited Loading

Zheng-Bicheng commented Mar 21, 2023 • edited Loading

Zheng-Bicheng commented Mar 21, 2023 • edited Loading

Ainavo commented Mar 22, 2023 • edited Loading

co63oc commented Mar 22, 2023 • edited Loading

Zheng-Bicheng commented Mar 23, 2023 • edited Loading

luotao1 commented Mar 23, 2023

tianshuo78520a commented Mar 31, 2023

qili93 commented Mar 31, 2023

tianshuo78520a commented Apr 7, 2023

RedContritio commented Apr 7, 2023 • edited Loading

Xingkai98 commented Apr 7, 2023

tipHkB5n commented Apr 7, 2023

ccsuzzh commented Apr 7, 2023 • edited Loading

luotao1 commented May 25, 2023

tianshuo78520a commented Mar 20, 2023 •

edited

Loading

Liyulingyue commented Mar 20, 2023 •

edited

Loading

Ainavo commented Mar 21, 2023 •

edited

Loading

Zheng-Bicheng commented Mar 21, 2023 •

edited

Loading

Zheng-Bicheng commented Mar 21, 2023 •

edited

Loading

Zheng-Bicheng commented Mar 21, 2023 •

edited

Loading

Zheng-Bicheng commented Mar 21, 2023 •

edited

Loading

Ainavo commented Mar 22, 2023 •

edited

Loading

co63oc commented Mar 22, 2023 •

edited

Loading

Zheng-Bicheng commented Mar 23, 2023 •

edited

Loading

RedContritio commented Apr 7, 2023 •

edited

Loading

ccsuzzh commented Apr 7, 2023 •

edited

Loading