Error: 'Error while copying content to a stream' for SQL data source transfer task¶

Symptoms:¶

Error during transfer task while ingesting data from a SQL server data source to an Ingest instance with Azure Data Lake storage. The error message typically includes:

Cause:¶

The issue is likely related to concurrency settings and resource limitations.

Resolution:¶

1. Increase Timeout Settings:

• Increase the timeouts for the Data Lake Ingest Instance in the TDI portal.
• Ensure the timeout is set to a value that accommodates the data transfer size.

1. Reduce Concurrent Execution Threads:

• Lower the number of concurrent execution threads to e.g. 2.
• This can be done in the Ingest Instance data source advanced settings.

1. Monitor and Adjust Resource Allocation:

• If reducing the threads resolves the issue, consider scaling up the VM running the Ingest Instance Server to handle more concurrent tasks.
• Monitor the performance and adjust CPU and memory allocation as needed.

Reference Ticket:¶

34258

Reference Links:¶

• Troubleshooting concurrency issues in Ingest Instance data sources