Skip to content

Source Zoho: Zoho CRM connector doesn't scroll to get more than 2000 records #30977

Open
@jtruty

Description

Connector Name

source-zoho-crm

Connector Version

0.1.2

What step the error happened?

During the sync

Revelant information

When trying to sync data for a Zoho client, we run into an issue when syncing objects with > 2000 records. The error seems to come from this part of the api docs: https://www.zoho.com/crm/developer/docs/api/v5/get-records.html#:~:text=You%20can%20use%20the%20%22page,token%20value%20is%20user%2Dspecific. The docs indicate we should be using the page_token param to scroll, while the connector is only using the page token to scroll.

Relevant log output

2023-10-02 13:12:50 destination > Writing 500 records to data_source: zohocrm, data_type: incremental_deals_zoho_crm_stream, data_id_field: id
2023-10-02 13:12:58 destination > Writing 500 records to data_source: zohocrm, data_type: incremental_deals_zoho_crm_stream, data_id_field: id
2023-10-02 13:13:05 destination > Writing 500 records to data_source: zohocrm, data_type: incremental_deals_zoho_crm_stream, data_id_field: id
2023-10-02 13:13:12 source > {"code":"DISCRETE_PAGINATION_LIMIT_EXCEEDED","details":{"limit":2000},"message":"You can only get the first 2000 records without using page_token param","status":"error"}


### Contribute

- [X] Yes, I want to contribute

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions