Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failed to execute the component roc and confusion_matrix in TFX sample for local mode #719

Closed
jinchihe opened this issue Jan 22, 2019 · 1 comment · Fixed by #720
Closed
Assignees

Comments

@jinchihe
Copy link
Member

Updated TFX sample to run pipeline end to end case locally, associated PV/PVC for date storage, instead of cloud storage. The process is almost finished but the roc and confusion_matrix component failed.

Logs are as following:

# kubectl logs tfx-taxi-cab-classification-pipeline-example-gxlkl-3361941409 -n kubeflow -c main
Traceback (most recent call last):
  File "/ml/roc.py", line 102, in <module>
    main()
  File "/ml/roc.py", line 74, in main
    df_roc.to_csv(f, columns=['fpr', 'tpr', 'thresholds'], header=False, index=False)
  File "/usr/local/lib/python2.7/dist-packages/pandas/core/frame.py", line 1344, in to_csv
    formatter.save()
  File "/usr/local/lib/python2.7/dist-packages/pandas/formats/format.py", line 1551, in save
    self._save()
  File "/usr/local/lib/python2.7/dist-packages/pandas/formats/format.py", line 1652, in _save
    self._save_chunk(start_i, end_i)
  File "/usr/local/lib/python2.7/dist-packages/pandas/formats/format.py", line 1678, in _save_chunk
    lib.write_csv_rows(self.data, ix, self.nlevels, self.cols, self.writer)
  File "pandas/lib.pyx", line 1075, in pandas.lib.write_csv_rows (pandas/lib.c:19767)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/lib/io/file_io.py", line 102, in write
    self._prewrite_check()
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/lib/io/file_io.py", line 88, in _prewrite_check
    compat.as_bytes(self.__name), compat.as_bytes(self.__mode), status)
  File "/usr/local/lib/python2.7/dist-packages/tensorflow/python/framework/errors_impl.py", line 473, in __exit__
    c_api.TF_GetCode(self.status.status))
**tensorflow.python.framework.errors_impl.NotFoundError: /output/tfx-taxi-cab-classification-pipeline-example-gxlkl/roc/roc.csv; No such file or directory**

Seems that's caused by the nonexistent directory. Seems the path need to be created if the path does not exist.

@jinchihe
Copy link
Member Author

Checked the related code, seems the directory is not created for local case, I am going to create a PR to enhance this, thanks.

Linchin pushed a commit to Linchin/pipelines that referenced this issue Apr 11, 2023
* Using GitHub apps as opposed to personal access tokens for automation
  is preferred.

  * GitHub apps are owned by the org and multiple individuals can be
    granted permission to administer them

  * This is much better than creating a shared github account

* Instead of shelling out to deprecated "hub CLI" for go; we are using
  the new GitHub CLI (github.com/cli/cli) as a library.

* Remove hub from the docker image because we no longer use it.
HumairAK pushed a commit to red-hat-data-services/data-science-pipelines that referenced this issue Mar 11, 2024
* skip license check due to go vanity website is down

* regenerate sdk dependency

* skip copy from genereated license

* add back license to verify
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants