File tree Expand file tree Collapse file tree 3 files changed +9
-10
lines changed
sql/core/src/main/scala/org/apache/spark/sql Expand file tree Collapse file tree 3 files changed +9
-10
lines changed Original file line number Diff line number Diff line change @@ -181,12 +181,6 @@ Data source options of ORC can be set via:
181
181
182
182
<table class =" table " >
183
183
<tr ><th ><b >Property Name</b ></th ><th ><b >Default</b ></th ><th ><b >Meaning</b ></th ><th ><b >Scope</b ></th ></tr >
184
- <tr >
185
- <td><code>maxFilesPerTrigger</code></td>
186
- <td>None</td>
187
- <td>Sets the maximum number of new files to be considered in every trigger.</td>
188
- <td>read</td>
189
- </tr >
190
184
<tr >
191
185
<td><code>mergeSchema</code></td>
192
186
<td>None</td>
Original file line number Diff line number Diff line change @@ -877,8 +877,8 @@ class DataFrameReader private[sql](sparkSession: SparkSession) extends Logging {
877
877
* ORC-specific option(s) for reading ORC files can be found in
878
878
* <a href=
879
879
* "https://spark.apache.org/docs/latest/sql-data-sources-orc.html#data-source-option">
880
- * Data Source Option</a>
881
- * and
880
+ * Data Source Option</a> in the version you use.
881
+ * More general options can be found in
882
882
* <a href=
883
883
* "https://spark.apache.org/docs/latest/sql-data-sources-generic-options.html">
884
884
* Generic Files Source Options</a> in the version you use.
Original file line number Diff line number Diff line change @@ -453,11 +453,16 @@ final class DataStreamReader private[sql](sparkSession: SparkSession) extends Lo
453
453
/**
454
454
* Loads a ORC file stream, returning the result as a `DataFrame`.
455
455
*
456
+ * You can set the following structured streaming option(s):
457
+ * <ul>
458
+ * <li>`maxFilesPerTrigger` (default: no max limit): sets the maximum number of new files to be
459
+ * considered in every trigger.</li>
460
+ *
456
461
* ORC-specific option(s) for reading ORC file stream can be found in
457
462
* <a href=
458
463
* "https://spark.apache.org/docs/latest/sql-data-sources-orc.html#data-source-option">
459
- * Data Source Option</a>
460
- * and
464
+ * Data Source Option</a> in the version you use.
465
+ * More general options can be found in
461
466
* <a href=
462
467
* "https://spark.apache.org/docs/latest/sql-data-sources-generic-options.html">
463
468
* Generic Files Source Options</a> in the version you use.
You can’t perform that action at this time.
0 commit comments