-
Notifications
You must be signed in to change notification settings - Fork 5.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
求问paddle v2怎么在训练时固定某些节点的参数使之不被更新 #3565
Comments
每个 fc_para_attr = paddle.attr.Param(learning_rate=0.)
fc1 = paddle.layer.fc(
input=inputs,
size=hid_dim,
act=linear,
param_attr=fc_para_attr,
) 关于学习率设置的详情,可参考#3302 |
@Xreki 感谢回答。我现在清楚怎么设置不同层的learning rate了。 |
学习过的参数不再更新,可以使用 |
@luotao1 还是没太明白,网络结构包括param_attr,学习率,不是在训练之前就定义好的吗?怎么根据不同的pass设置不同的param_attr呢? |
暂时关闭此Issue了,如果仍存在问题,可以reopen |
我大概有这样的需求:
跑第一个pass的时候,只更新稀疏特征的参数,学习这部分特征的规律
跑第二个pass的时候,加入稠密特征,之前学习到的稀疏特征的参数不再被更新
求问应该怎么搞呢
The text was updated successfully, but these errors were encountered: