Skip to content

feat: Postgres offline_write_batch #4452

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

Atry
Copy link
Contributor

@Atry Atry commented Aug 26, 2024

What this PR does / why we need it:

Implement offline_write_batch for postgresql offline store.

Which issue(s) this PR fixes:

Fixes #3759

Misc

This PR is based on #3767, with some extra changes to create the table if it does not exist

@Atry Atry force-pushed the postgresql_offline_write_batch branch 2 times, most recently from 4a93002 to d8e0722 Compare August 26, 2024 20:00
@Atry Atry marked this pull request as ready for review August 26, 2024 20:00
@@ -229,6 +237,59 @@ def pull_all_from_table_or_query(
on_demand_feature_views=None,
)

if "adbc_driver_postgresql" in sys.modules:

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

could we instead add this to the config optionally?

Copy link
Contributor Author

@Atry Atry Aug 26, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@franciscojavierarceo What config?

Co-authored-by: Nikita Demashov <n.demashov@yadro.com>
Signed-off-by: Yang, Bo <bo.yang@protonbase.io>
@Atry Atry force-pushed the postgresql_offline_write_batch branch from d8e0722 to 2145d1d Compare August 26, 2024 21:13
@VitalyDubovets
Copy link

VitalyDubovets commented Dec 17, 2024

@Atry @franciscojavierarceo hello. Are you planning to resume any activity on this MR? I reckon it's really necessary thing, because the current realization of PostgreSQLOfflineStore looks incomplete. I can bring some help if necessary.

@redhatHameed
Copy link
Contributor

@Atry can you rebase this

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Write to postgres offline store
5 participants