高层API恢复训练问题
收藏
为什么不能使用model.load( )恢复训练,依然是从头开始训练,到底是哪出现问题了呢,求教!!
0
收藏
请登录后评论
能够把报错贴出来看一下嘛?
这方面再训练可以参考一下paddle高阶AIP课程,里面有详尽描述
谢谢回复,不是报错,是我想接着上次的第15轮继续训练,然后使用mode.load( )加载断点模型,但仍然是从头开始训练。
# example 1: dynamic graph
import paddle
emb = paddle.nn.Embedding(10, 10)
layer_state_dict = emb.state_dict()
# save state_dict of emb
paddle.save(layer_state_dict, "emb.pdparams")
scheduler = paddle.optimizer.lr.NoamDecay(
d_model=0.01, warmup_steps=100, verbose=True)
adam = paddle.optimizer.Adam(
learning_rate=scheduler,
parameters=emb.parameters())
opt_state_dict = adam.state_dict()
# save state_dict of optimizer
paddle.save(opt_state_dict, "adam.pdopt")
# save weight of emb
paddle.save(emb.weight, "emb.weight.pdtensor")
# load state_dict of emb
load_layer_state_dict = paddle.load("emb.pdparams")
# load state_dict of optimizer
load_opt_state_dict = paddle.load("adam.pdopt")
# load weight of emb
load_weight = paddle.load("emb.weight.pdtensor")
emb.weight.set_value(load_weight)