[object detection] TypeError: can't pickle dict_values objects

[jj19940807]

creating index...
index created!
2018-07-16 22:12:38.626883: W T:\src\github\tensorflow\tensorflow\core\framework
\op_kernel.cc:1306] Invalid argument: TypeError: can't pickle dict_values objects
Traceback (most recent call last):

File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\ops\scrip
t_ops.py", line 158, in call
ret = func(*args)

File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\metrics\coco_evaluation.py", line 339, in first_value_func
self._metrics = self.evaluate()

File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\metrics\coco_evaluation.py", line 193, in evaluate
self._detection_boxes_list)

File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\metrics\coco_tools.py", line 118, in LoadAnnotations
results.dataset['categories'] = copy.deepcopy(self.dataset['categories'])

File "d:\Program Files\Anaconda3\lib\copy.py", line 174, in deepcopy
rv = reductor(4)

TypeError: can't pickle dict_values objects

Traceback (most recent call last):
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\se
ssion.py", line 1322, in _do_call
return fn(*args)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\se
ssion.py", line 1307, in _run_fn
options, feed_dict, fetch_list, target_list, run_metadata)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\se
ssion.py", line 1409, in _call_tf_sessionrun
run_metadata)
tensorflow.python.framework.errors_impl.InvalidArgumentError: TypeError: can't p
ickle dict_values objects
Traceback (most recent call last):

File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\ops\scrip
t_ops.py", line 158, in call
ret = func(*args)

File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\metrics\coco_evaluation.py", line 339, in first_value_func
self._metrics = self.evaluate()

File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\metrics\coco_evaluation.py", line 193, in evaluate
self._detection_boxes_list)

File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\metrics\coco_tools.py", line 118, in LoadAnnotations
results.dataset['categories'] = copy.deepcopy(self.dataset['categories'])

File "d:\Program Files\Anaconda3\lib\copy.py", line 174, in deepcopy
rv = reductor(4)

TypeError: can't pickle dict_values objects

     [[Node: PyFunc_1 = PyFunc[Tin=[], Tout=[DT_FLOAT], token="pyfunc_3", _d

evice="/job:localhost/replica:0/task:0/device:CPU:0"]()]]

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
File "object_detection\model_main.py", line 101, in
tf.app.run()
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\platform
app.py", line 125, in run
_sys.exit(main(argv))
File "object_detection\model_main.py", line 97, in main
tf.estimator.train_and_evaluate(estimator, train_spec, eval_specs[0])
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\estimator
\training.py", line 447, in train_and_evaluate
return executor.run()
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\estimator
\training.py", line 531, in run
return self.run_local()
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\estimator
\training.py", line 681, in run_local
eval_result, export_results = evaluator.evaluate_and_export()
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\estimator
\training.py", line 886, in evaluate_and_export
hooks=self._eval_spec.hooks)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\estimator
\estimator.py", line 460, in evaluate
output_dir=self.eval_dir(name))
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\estimator
\estimator.py", line 1386, in _evaluate_run
config=self._session_config)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\training
evaluation.py", line 212, in _evaluate_once
session.run(eval_ops, feed_dict)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\training
monitored_session.py", line 689, in exit
self._close_internal(exception_type)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\training
monitored_session.py", line 721, in _close_internal
h.end(self._coordinated_creator.tf_sess)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\training
basic_session_run_hooks.py", line 824, in end
self._final_ops, feed_dict=self._final_ops_feed_dict)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\se
ssion.py", line 900, in run
run_metadata_ptr)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\se
ssion.py", line 1135, in _run
feed_dict_tensor, options, run_metadata)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\se
ssion.py", line 1316, in _do_run
run_metadata)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\client\se
ssion.py", line 1335, in _do_call
raise type(e)(node_def, op, message)
tensorflow.python.framework.errors_impl.InvalidArgumentError: TypeError: can't p
ickle dict_values objects
Traceback (most recent call last):

File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\ops\scrip
t_ops.py", line 158, in call
ret = func(*args)

File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\metrics\coco_evaluation.py", line 339, in first_value_func
self._metrics = self.evaluate()

File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\metrics\coco_evaluation.py", line 193, in evaluate
self._detection_boxes_list)

File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\metrics\coco_tools.py", line 118, in LoadAnnotations
results.dataset['categories'] = copy.deepcopy(self.dataset['categories'])

File "d:\Program Files\Anaconda3\lib\copy.py", line 174, in deepcopy
rv = reductor(4)

TypeError: can't pickle dict_values objects

     [[Node: PyFunc_1 = PyFunc[Tin=[], Tout=[DT_FLOAT], token="pyfunc_3", _d

evice="/job:localhost/replica:0/task:0/device:CPU:0"]()]]

Caused by op 'PyFunc_1', defined at:
File "object_detection\model_main.py", line 101, in
tf.app.run()
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\platform
app.py", line 125, in run
_sys.exit(main(argv))
File "object_detection\model_main.py", line 97, in main
tf.estimator.train_and_evaluate(estimator, train_spec, eval_specs[0])
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\estimator
\training.py", line 447, in train_and_evaluate
return executor.run()
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\estimator
\training.py", line 531, in run
return self.run_local()
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\estimator
\training.py", line 681, in run_local
eval_result, export_results = evaluator.evaluate_and_export()
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\estimator
\training.py", line 886, in evaluate_and_export
hooks=self._eval_spec.hooks)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\estimator
\estimator.py", line 453, in evaluate
input_fn, hooks, checkpoint_path)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\estimator
\estimator.py", line 1348, in _evaluate_build_graph
features, labels, model_fn_lib.ModeKeys.EVAL, self.config)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\estimator
\estimator.py", line 1107, in _call_model_fn
model_fn_results = self._model_fn(features=features, **kwargs)
File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\model_lib.py", line 383, in model_fn
include_metrics_per_category=eval_config.include_metrics_per_category)
File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\eval_util.py", line 629, in get_eval_metric_ops_for_evaluators
input_data_fields.groundtruth_is_crowd)))
File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\metrics\coco_evaluation.py", line 349, in get_estimator_eval_me
tric_ops
first_value_op = tf.py_func(first_value_func, [], tf.float32)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\ops\scrip
t_ops.py", line 384, in py_func
func=func, inp=inp, Tout=Tout, stateful=stateful, eager=False, name=name)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\ops\scrip
t_ops.py", line 227, in _internal_py_func
input=inp, token=token, Tout=Tout, name=name)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\ops\gen_s
cript_ops.py", line 130, in py_func
"PyFunc", input=input, token=token, Tout=Tout, name=name)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\framework
\op_def_library.py", line 787, in _apply_op_helper
op_def=op_def)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\framework
\ops.py", line 3414, in create_op
op_def=op_def)
File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\framework
\ops.py", line 1740, in init
self._traceback = self._graph._extract_stack() # pylint: disable=protected-
access

InvalidArgumentError (see above for traceback): TypeError: can't pickle dict_val
ues objects
Traceback (most recent call last):

File "d:\Program Files\Anaconda3\lib\site-packages\tensorflow\python\ops\scrip
t_ops.py", line 158, in call
ret = func(*args)

File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\metrics\coco_evaluation.py", line 339, in first_value_func
self._metrics = self.evaluate()

File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\metrics\coco_evaluation.py", line 193, in evaluate
self._detection_boxes_list)

File "D:\Program Files\Anaconda3\Lib\site-packages\tensorflow\models\research
object_detection\metrics\coco_tools.py", line 118, in LoadAnnotations
results.dataset['categories'] = copy.deepcopy(self.dataset['categories'])

File "d:\Program Files\Anaconda3\lib\copy.py", line 174, in deepcopy
rv = reductor(4)

TypeError: can't pickle dict_values objects

     [[Node: PyFunc_1 = PyFunc[Tin=[], Tout=[DT_FLOAT], token="pyfunc_3", _d

evice="/job:localhost/replica:0/task:0/device:CPU:0"]()]]

[pkulzc]

Were you using python2 or 3?

[darthsuogles]

I am seeing the same issue, with python 3.6

[pkulzc]

I'm not 100% sure but could you try with python2 ?

[MaeThird]

If you're using python3 , add list() to category_index.values() in model_lib.py about line 381 as this list(category_index.values()).

[jj19940807]

Thank you very much for your help, my problem is solved, I did use Python 3.5

[radzfoto]

I had the same problem with Python 3.6.5. I then created a Python 2.7.15 virtualenv and ran through the tf obj det installation requirements. It ran perfectly on a reasonably sized dataset (nearly 10,000 images). So clearly, this and about a half dozen other issues that I found (and others have already submitted) are all related to incompatibilities with Python 3.

[MohammadMoradi]

Same problem and solved with MaeThird fix. Thanks!
I think support for pyhon3 should be added.

[whSwitching]

got a same issue and solved with @MaeThird 's fix. Thanks!

[jcRisch]

 Solved with @MaeThird 's fix. model_lib.py is in models/research/object_detection/ and category_index.values() was at line 390 for me.

[junweima]

@MaeThird Thanks.