Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support stream priority for standalone executor #49939

Conversation

From00
Copy link
Contributor

@From00 From00 commented Jan 19, 2023

PR types

New features

PR changes

Others

Describe

#47411 支持自定义OP执行流基础上,本PR支持在dist_attr中为自定义流指定优先级。
由于流优先级是在底层调用CUDA API创建流时进行指定,在流创建之后不可更改,因此一个流只能对应一个优先级。这个约束由上层进行保证,若出现多个指定了相同流的OP设置了不同的优先级,则该流的优先级会与Program中第一个OP的设定相同。

@paddle-bot
Copy link

paddle-bot bot commented Jan 19, 2023

你的PR提交成功,感谢你对开源项目的贡献!
请关注后续CI自动化测试结果,详情请参考Paddle-CI手册
Your PR has been submitted. Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

Copy link
Contributor

@zhiqiu zhiqiu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Contributor

@XiaoguangHu01 XiaoguangHu01 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@From00 From00 closed this Jan 30, 2023
@From00 From00 reopened this Jan 30, 2023
@From00 From00 merged commit 172d1de into PaddlePaddle:develop Jan 30, 2023
pangengzheng pushed a commit to pangengzheng/Paddle that referenced this pull request Feb 2, 2023
* Support stream priority for standalone executor

* Fix compile error

* Fix compile error

* Fix compile error

* Fix compile error

* Fix compile error
@From00 From00 deleted the support-stream-priority-for-standalone-executor branch April 5, 2023 09:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants