We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 4cb8ac5 commit fe64c98Copy full SHA for fe64c98
pyspark_datasources/salesforce.py
@@ -34,6 +34,11 @@ class SalesforceDataSource(DataSource):
34
- Uses Salesforce username/password/security token authentication
35
- Supports batch writing with Salesforce Composite Tree API for efficient processing
36
- Implements exactly-once semantics through Spark's checkpoint mechanism
37
+ - If a streaming write job fails and is resumed from the checkpoint,
38
+ it will not overwrite records already written in Salesforce;
39
+ it resumes from the last committed offset.
40
+ However, if records were written to Salesforce but not yet committed at the time of failure,
41
+ duplicate records may occur after recovery.
42
43
Parameters
44
----------
0 commit comments