Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Documentation enhancements for managedtabledataset #2878

Open
stichbury opened this issue Aug 1, 2023 · 1 comment
Open

Documentation enhancements for managedtabledataset #2878

stichbury opened this issue Aug 1, 2023 · 1 comment
Labels
Component: Documentation πŸ“„ Issue/PR for markdown and API documentation

Comments

@stichbury
Copy link
Contributor

stichbury commented Aug 1, 2023

See more information here (from @datajoely)

Hi fellows, I followed the documentation for packaging Iris on databricks and it works really well πŸ‘. I wanted to go a step further, using ManagedTableDataset β€” which works great too β€” and run different independent pipelines defined on the same project, but I did not manage to do so.
I modified the databricks_run.py to account for a --pipeline option but I think the problem is in packaging the project which does not take into account pipelines created through kedro pipeline create if I am not mistaken (but I probably am). Would you point me towards my mistake?

https://linen-slack.kedro.org/t/13547186/hi-fellows-i-followed-the-documentation-for-packaging-https-#ecacc832-e76f-4b05-92d6-9594bb6f4529

@stichbury stichbury changed the title Airflow logging query via Slack...title to be changed Documentation enhancements for managedtabledataset Aug 1, 2023
@stichbury stichbury added the Component: Documentation πŸ“„ Issue/PR for markdown and API documentation label Aug 1, 2023
@datajoely
Copy link
Contributor

I think we may need to tweak the starter template too

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Component: Documentation πŸ“„ Issue/PR for markdown and API documentation
Projects
Status: No status
Development

No branches or pull requests

2 participants