Getting a timeout error when trying to load results from a s3

2

Hi @nafeger

Can you please edit your S3 data source settings and let me know the value for the property “fs.s3a.connection.maximum”?

If it is not present, try increasing it to something like 1000 to start with. See attached screenshot and reference link below

Timeout waiting for connection from pool

“Timeout waiting for connection from pool” when reading from S3A
This happens when more threads are trying to read from an S3A system than the maximum number of allocated HTTP connections.

Set fs.s3a.connection.maximum to a larger value (and at least as large as fs.s3a.threads.max)

maximum
fs.s3a.connection.maximum.jpg2552×1582 182 KB

Thanks,
@balaji.ramaswamy

1 Like