[bug] Repo upsert transaction timed-out when syncing large connections

[brendan-kellam]

Describe the bug

When dealing with large connections that have many thousands of repos, the following ORM error can be hit:

Transaction API error: Transaction already closed: A query cannot be executed on an expired transaction. The timeout for this transaction was 10000 ms, however 10002 ms passed since the start of the transaction. Consider increasing the interactive transaction timeout or doing less work in the transaction.

To reproduce

NA

Sourcebot deployment information

Sourcebot version (e.g. v3.0.1): v3.0.1

Additional information

Note: If you hit this issue, you can try bumping the CONNECTION_MANAGER_UPSERT_TIMEOUT_MS environment variable to a larger value (e.g., 300000 for 5 minutes). Longer term fix will be to avoid using a interactive timeout.