Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🐛 Source Shopify: Have message and description be nullable for custom_collections delet… #45116

Conversation

maxi297
Copy link
Contributor

@maxi297 maxi297 commented Sep 3, 2024

…ed events

What

Addresses https://github.com/airbytehq/oncall/issues/6400 where some events have been seen to not have all the fields we expect.

Note that we haven't seen a case where description is not provided but as the field is deprecated, it makes sense to assume it won't be provided soon.

How

Assume they are nullable in the Python call by calling .get(<field>, None) from the dict in the response

Review guide

User Impact

This should allow streams to succeed but the fields that Shopify do not send us anymore will be missing

Can this PR be safely reverted and rolled back?

  • YES 💚
  • NO ❌

Copy link

vercel bot commented Sep 3, 2024

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
airbyte-docs ✅ Ready (Inspect) Visit Preview 💬 Add feedback Sep 3, 2024 11:56pm

@maxi297 maxi297 changed the title Have message and description be nullable for custom_collections delet… 🐛 Source Shopify: Have message and description be nullable for custom_collections delet… Sep 3, 2024
Copy link
Contributor

@girarda girarda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🚢

@octavia-squidington-iii octavia-squidington-iii added the area/documentation Improvements or additions to documentation label Sep 3, 2024
Copy link
Contributor

@aldogonzalez8 aldogonzalez8 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

APPROVED

@maxi297
Copy link
Contributor Author

maxi297 commented Sep 4, 2024

/approve-regression-tests

test_record_schema_match_without_state

I'm not sure I get this test result as in both version when I run locally, I have fields like deleted_at for the stream custom_collections. I will assume this is because the stream is failing like it currently is for the users in prod

test_all_records_are_the_same_without_state

Checking the regression tests, articles, blogs, custom_collections, pages and price_rules are expected to change because they have deleted events. However, products was not supposed to change but it seems to be related to a preview URL that changed so I'm fine with this as the format of those fields are similar (there are also similar errors in other PR here).

Check job output.

✅ Approving regression tests

@maxi297 maxi297 merged commit 1f2fd6e into master Sep 4, 2024
35 checks passed
@maxi297 maxi297 deleted the oncall-6400/shopify-allow-message-and-description-to-be-nullable branch September 4, 2024 01:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
area/connectors Connector related issues area/documentation Improvements or additions to documentation connectors/source/shopify
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants