TensorFlow:合并两个图后从两个检查点恢复变量

2024-10-02 00:23:49 发布

您现在位置:Python中文网/ 问答频道 /正文

我有一个关于TensorFlow的问题,希望你能帮忙:D

我的目标是:假设我有两个图,图A和图B,每一个由三个卷积层组成。我想把图A的第二层链接到图B的第三层

我使用这里给出的信息成功地组合了两个图:Tensorflow: How to replace a node in a calculation graph?

我得到的是: enter image description here

当我试图加载可变权重时,问题就来了。我遵循了这个解决方案,但没有成功:TensorFlow: Restoring variables from from multiple checkpoints

加载图A的权重时没有问题,但在加载图B的权重时会出现此错误

INFO:tensorflow:Restoring parameters from ./models/merge_graph_A.ckpt
INFO:tensorflow:Restoring parameters from ./models/merge_graph_B.ckpt
---------------------------------------------------------------------------
NotFoundError                             Traceback (most recent call last)
<ipython-input-27-1e08224fde39> in <module>()
      1 with tf.Session(graph=graphs_merged) as sess:
      2     saver_A.restore(sess, './models/merge_graph_A.ckpt')
----> 3     saver_B.restore(sess, './models/merge_graph_B.ckpt')
      4 
      5     outcome = sess.run(output, feed_dict={

/home/solano/.local/lib/python2.7/site-packages/tensorflow/python/training/saver.pyc in restore(self, sess, save_path)
   1753     if context.in_graph_mode():
   1754       sess.run(self.saver_def.restore_op_name,
-> 1755                {self.saver_def.filename_tensor_name: save_path})
   1756     else:
   1757       self._build_eager(save_path, build_save=False, build_restore=True)

/home/solano/.local/lib/python2.7/site-packages/tensorflow/python/client/session.pyc in run(self, fetches, feed_dict, options, run_metadata)
    903     try:
    904       result = self._run(None, fetches, feed_dict, options_ptr,
--> 905                          run_metadata_ptr)
    906       if run_metadata:
    907         proto_data = tf_session.TF_GetBuffer(run_metadata_ptr)

/home/solano/.local/lib/python2.7/site-packages/tensorflow/python/client/session.pyc in _run(self, handle, fetches, feed_dict, options, run_metadata)
   1135     if final_fetches or final_targets or (handle and feed_dict_tensor):
   1136       results = self._do_run(handle, final_targets, final_fetches,
-> 1137                              feed_dict_tensor, options, run_metadata)
   1138     else:
   1139       results = []

/home/solano/.local/lib/python2.7/site-packages/tensorflow/python/client/session.pyc in _do_run(self, handle, target_list, fetch_list, feed_dict, options, run_metadata)
   1353     if handle is None:
   1354       return self._do_call(_run_fn, self._session, feeds, fetches, targets,
-> 1355                            options, run_metadata)
   1356     else:
   1357       return self._do_call(_prun_fn, self._session, handle, feeds, fetches)

/home/solano/.local/lib/python2.7/site-packages/tensorflow/python/client/session.pyc in _do_call(self, fn, *args)
   1372         except KeyError:
   1373           pass
-> 1374       raise type(e)(node_def, op, message)
   1375 
   1376   def _extend_graph(self):

NotFoundError: Key Variables_A/W_c1 not found in checkpoint
     [[Node: save/RestoreV2 = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save/Const_0_0, save/RestoreV2/tensor_names, save/RestoreV2/shape_and_slices)]]

Caused by op u'save/RestoreV2', defined at:
  File "/usr/lib/python2.7/runpy.py", line 174, in _run_module_as_main
    "__main__", fname, loader, pkg_name)
  File "/usr/lib/python2.7/runpy.py", line 72, in _run_code
    exec code in run_globals
  File "/home/solano/.local/lib/python2.7/site-packages/ipykernel_launcher.py", line 16, in <module>
    app.launch_new_instance()
  File "/home/solano/.local/lib/python2.7/site-packages/traitlets/config/application.py", line 658, in launch_instance
    app.start()
  File "/home/solano/.local/lib/python2.7/site-packages/ipykernel/kernelapp.py", line 486, in start
    self.io_loop.start()
  File "/home/solano/.local/lib/python2.7/site-packages/zmq/eventloop/ioloop.py", line 177, in start
    super(ZMQIOLoop, self).start()
  File "/home/solano/.local/lib/python2.7/site-packages/tornado/ioloop.py", line 888, in start
    handler_func(fd_obj, events)
  File "/home/solano/.local/lib/python2.7/site-packages/tornado/stack_context.py", line 277, in null_wrapper
    return fn(*args, **kwargs)
  File "/home/solano/.local/lib/python2.7/site-packages/zmq/eventloop/zmqstream.py", line 440, in _handle_events
    self._handle_recv()
  File "/home/solano/.local/lib/python2.7/site-packages/zmq/eventloop/zmqstream.py", line 472, in _handle_recv
    self._run_callback(callback, msg)
  File "/home/solano/.local/lib/python2.7/site-packages/zmq/eventloop/zmqstream.py", line 414, in _run_callback
    callback(*args, **kwargs)
  File "/home/solano/.local/lib/python2.7/site-packages/tornado/stack_context.py", line 277, in null_wrapper
    return fn(*args, **kwargs)
  File "/home/solano/.local/lib/python2.7/site-packages/ipykernel/kernelbase.py", line 283, in dispatcher
    return self.dispatch_shell(stream, msg)
  File "/home/solano/.local/lib/python2.7/site-packages/ipykernel/kernelbase.py", line 233, in dispatch_shell
    handler(stream, idents, msg)
  File "/home/solano/.local/lib/python2.7/site-packages/ipykernel/kernelbase.py", line 399, in execute_request
    user_expressions, allow_stdin)
  File "/home/solano/.local/lib/python2.7/site-packages/ipykernel/ipkernel.py", line 208, in do_execute
    res = shell.run_cell(code, store_history=store_history, silent=silent)
  File "/home/solano/.local/lib/python2.7/site-packages/ipykernel/zmqshell.py", line 537, in run_cell
    return super(ZMQInteractiveShell, self).run_cell(*args, **kwargs)
  File "/home/solano/.local/lib/python2.7/site-packages/IPython/core/interactiveshell.py", line 2718, in run_cell
    interactivity=interactivity, compiler=compiler, result=result)
  File "/home/solano/.local/lib/python2.7/site-packages/IPython/core/interactiveshell.py", line 2822, in run_ast_nodes
    if self.run_code(code, result):
  File "/home/solano/.local/lib/python2.7/site-packages/IPython/core/interactiveshell.py", line 2882, in run_code
    exec(code_obj, self.user_global_ns, self.user_ns)
  File "<ipython-input-22-4397b861df66>", line 5, in <module>
    return_elements=["conv_A_2/output:0"], name="")
  File "/home/solano/.local/lib/python2.7/site-packages/tensorflow/python/util/deprecation.py", line 432, in new_func
    return func(*args, **kwargs)
  File "/home/solano/.local/lib/python2.7/site-packages/tensorflow/python/framework/importer.py", line 553, in import_graph_def
    op_def=op_def)
  File "/home/solano/.local/lib/python2.7/site-packages/tensorflow/python/framework/ops.py", line 3271, in create_op
    op_def=op_def)
  File "/home/solano/.local/lib/python2.7/site-packages/tensorflow/python/framework/ops.py", line 1650, in __init__
    self._traceback = self._graph._extract_stack()  # pylint: disable=protected-access

NotFoundError (see above for traceback): Key Variables_A/W_c1 not found in checkpoint
     [[Node: save/RestoreV2 = RestoreV2[dtypes=[DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT, DT_FLOAT], _device="/job:localhost/replica:0/task:0/device:CPU:0"](_arg_save/Const_0_0, save/RestoreV2/tensor_names, save/RestoreV2/shape_and_slices)]]

真正有趣的是,如果我改变合并的顺序,从B取前两层,从A取第三层,当加载图A的权值时,就会出现错误,正好相反。在


编码

加载图A

^{pr2}$

加载图B

tf.reset_default_graph()
graph_B = tf.Graph()

with graph_B.as_default():
    saver_B = tf.train.import_meta_graph('./models/merge_graph_B.ckpt.meta')

graph_B_def = graph_B.as_graph_def()

合并两个图形:

tf.reset_default_graph() # not necessary
with tf.Graph().as_default() as graphs_merged:
    input_image = tf.placeholder(tf.float32, (None, None, None, 3), name='input')

    bottleneck, = tf.import_graph_def(graph_A_def, input_map={"input_A:0": input_image},
                           return_elements=["conv_A_2/output:0"], name="")

    # Notice how the input is the bottleneck.
    output, = tf.import_graph_def(graph_B_def, input_map={"conv_B_2/output:0": bottleneck}, # HERE'S THE PROBLEM
                           return_elements=["conv_B_3/output:0"], name="")

装载重量:

with tf.Session(graph=graphs_merged) as sess:
    saver_A.restore(sess, './models/merge_graph_A.ckpt')
    saver_B.restore(sess, './models/merge_graph_B.ckpt') # HERE'S THE PROBLEM

    outcome = sess.run(output, feed_dict={
        input_image: image_test
    })

谢谢大家!!!在


编辑:这是节省程序的问题。所有检查点都以相同的前缀“save”保存。这导致在合并时,TensorFlow将第二个图的前缀改为“save_1”,使saver无法找到必须还原的变量,而是尝试使用前缀为“save”的操作还原变量。

所以问题变了:在这里导入元图之后,有没有办法更改这个操作的名称:saver_A = tf.train.import_meta_graph('./models/merge_graph_A.ckpt.meta')?在

save/Const
save/SaveV2/tensor_names
save/SaveV2/shape_and_slices
save/SaveV2
save/control_dependency
save/RestoreV2/tensor_names
save/RestoreV2/shape_and_slices
save/RestoreV2
save/Assign
save/Assign_1
save/Assign_2
save/Assign_3
save/Assign_4
save/Assign_5
save/restore_all

save_1/Const
save_1/SaveV2/tensor_names
save_1/SaveV2/shape_and_slices
save_1/SaveV2
save_1/control_dependency
save_1/RestoreV2/tensor_names
save_1/RestoreV2/shape_and_slices
save_1/RestoreV2
save_1/Assign
save_1/Assign_1
save_1/Assign_2
save_1/Assign_3
save_1/Assign_4
save_1/Assign_5
save_1/restore_all

Tags: runinpyselfhomesavelibpackages

热门问题