Skip to content

Commit 9ab71c6

Browse files
committed
Adding max.docs.per.partition documentation
1 parent c13028b commit 9ab71c6

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

docs/src/reference/asciidoc/core/configuration.adoc

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -360,6 +360,13 @@ WARN main mr.EsInputFormat - Field(s) [naem, adress] not found
360360
in the Elasticsearch mapping specified; did you mean [name, location.address]?
361361
----
362362

363+
[float]
364+
==== Input
365+
366+
added[5.0.0]
367+
`es.input.max.docs.per.partition` (default 100000)::
368+
When reading from an {es} cluster that supports scroll slicing ({es} v5.0.0 and above), this parameter advises the connector on what the maximum number of documents per input partition should be. The connector will sample and estimate the number of documents on each shard to be read and divides each shard into input slices using the value supplied by this property. This property is ignored if you are reading from an {es} cluster that does not support scroll slicing ({es} any version below v5.0.0).
369+
363370
[float]
364371
==== Network
365372

0 commit comments

Comments
 (0)