Skip to content

Fix bulkWrite BSON error #154

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Dec 9, 2024
Merged

Fix bulkWrite BSON error #154

merged 4 commits into from
Dec 9, 2024

Conversation

rkistner
Copy link
Contributor

@rkistner rkistner commented Dec 9, 2024

Sample error seen during replication:

MongoBulkWriteError: BSONObj size: 16814023 (0x1008FC7) is invalid. Size must be between 0 and 16793600(16MB) First element: insert: "bucket_data"

The issue is triggered much more often since v6.10.0 of the MongoDB NodeJS driver, which we're using on the cloud service. While the bug is present earlier, v6.10.0 increases the maximum number of documents in a batch (was 1000), which makes it easier to trigger this issue.

Upstream issue reported: https://jira.mongodb.org/browse/NODE-6608

Copy link

changeset-bot bot commented Dec 9, 2024

🦋 Changeset detected

Latest commit: 5f51e5f

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 6 packages
Name Type
@powersync/service-module-postgres Patch
@powersync/service-module-mongodb Patch
@powersync/service-core Patch
@powersync/service-image Patch
@powersync/service-module-mysql Patch
test-client Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@rkistner rkistner marked this pull request as ready for review December 9, 2024 14:07
@rkistner rkistner merged commit 889ac46 into main Dec 9, 2024
15 checks passed
@rkistner rkistner deleted the fix-bulkwrite-bson-size branch December 9, 2024 15:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants