Skip to content

Commit 91a1dee

Browse files
committed
Describe pathGlobFilter
1 parent 5016556 commit 91a1dee

File tree

1 file changed

+6
-0
lines changed

1 file changed

+6
-0
lines changed

docs/sql-data-sources-avro.md

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -233,6 +233,12 @@ Data source options of Avro can be set via:
233233
<td>The option controls ignoring of files without <code>.avro</code> extensions in read.<br> If the option is enabled, all files (with and without <code>.avro</code> extension) are loaded.<br> The option has been already deprecated, and it will be removed in the future releases. Please use the general data source option <code>pathGlobFilter</code> for filtering file names.</td>
234234
<td>read</td>
235235
</tr>
236+
<tr>
237+
<td><code>pathGlobFilter</code></td>
238+
<td>""</td>
239+
<td>The option specifies an optional glob pattern to only include files with paths matching the pattern. The syntax follows <code>org.apache.hadoop.fs.GlobFilter</code>. It does not change the behavior of partition discovery.</td>
240+
<td>read</td>
241+
</tr>
236242
<tr>
237243
<td><code>compression</code></td>
238244
<td>snappy</td>

0 commit comments

Comments
 (0)