-
Notifications
You must be signed in to change notification settings - Fork 6.8k
Silence excessive mkldnn logging output on tests. #14947
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM
Minor question, is this only for CI purpose?
@@ -553,8 +553,9 @@ void OpCheck::Run(mxnet::FCompute fn, const nnvm::NodeAttrs &attrs, | |||
for (size_t i = 0; i < out_blobs.size(); i++) | |||
out_blobs[i] = outputs[i].data(); | |||
fn(attrs, ctx, in_blobs, req, out_blobs); | |||
|
|||
#ifndef NDEBUG |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you for fixing this. How about changing to check the environmental variable MXNET_MKLDNN_DEBUG
? We used this variable in other places.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@TaoLv sure, will do that.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thank you @larroy . We're thinking about adding verbose levels to MXNET_MKLDNN_DEBUG
in the future.
@pengzhao-intel I saw this excessive log output and had a 3h timeout on tests, wanted to see if the PR validation time goes down because of this, probably not related. |
@larroy Sorry just notice that you're trying to save time of CI? I remember |
How about turning it off because we have enough test cases in the CI for MKLDNN now? |
Thank you for your improvement. Merge now. |
* Silence excessive mkldnn logging output on tests. http://jenkins.mxnet-ci.amazon-ml.com/blue/rest/organizations/jenkins/pipelines/mxnet-validation/pipelines/unix-cpu/branches/PR-14940/runs/1/nodes/283/steps/749/log/?start=0 * As per Peng Zhao and Tao Lv suggestion
Description
Silenced excessive logging output:
http://jenkins.mxnet-ci.amazon-ml.com/blue/rest/organizations/jenkins/pipelines/mxnet-validation/pipelines/unix-cpu/branches/PR-14940/runs/1/nodes/283/steps/749/log/?start=0
Checklist
Essentials
Please feel free to remove inapplicable items for your PR.