Open
Description
Connector Name
source-zoho-crm
Connector Version
0.1.2
What step the error happened?
During the sync
Revelant information
When trying to sync data for a Zoho client, we run into an issue when syncing objects with > 2000 records. The error seems to come from this part of the api docs: https://www.zoho.com/crm/developer/docs/api/v5/get-records.html#:~:text=You%20can%20use%20the%20%22page,token%20value%20is%20user%2Dspecific. The docs indicate we should be using the page_token
param to scroll, while the connector is only using the page
token to scroll.
Relevant log output
2023-10-02 13:12:50 destination > Writing 500 records to data_source: zohocrm, data_type: incremental_deals_zoho_crm_stream, data_id_field: id
2023-10-02 13:12:58 destination > Writing 500 records to data_source: zohocrm, data_type: incremental_deals_zoho_crm_stream, data_id_field: id
2023-10-02 13:13:05 destination > Writing 500 records to data_source: zohocrm, data_type: incremental_deals_zoho_crm_stream, data_id_field: id
2023-10-02 13:13:12 source > {"code":"DISCRETE_PAGINATION_LIMIT_EXCEEDED","details":{"limit":2000},"message":"You can only get the first 2000 records without using page_token param","status":"error"}
### Contribute
- [X] Yes, I want to contribute