File tree Expand file tree Collapse file tree 1 file changed +5
-3
lines changed
core/src/main/scala/org/apache/spark Expand file tree Collapse file tree 1 file changed +5
-3
lines changed Original file line number Diff line number Diff line change @@ -831,7 +831,8 @@ class SparkContext(config: SparkConf) extends Logging with ExecutorAllocationCli
831831 * }}}
832832 *
833833 * @note Small files are preferred, large file is also allowable, but may cause bad performance.
834- *
834+ * @note On some filesystems, `.../path/*` can be a more efficient way to read all files
835+ * in a directory rather than `.../path/` or `.../path`
835836 * @param minPartitions A suggestion value of the minimal splitting number for input data.
836837 */
837838 def wholeTextFiles (
@@ -878,9 +879,10 @@ class SparkContext(config: SparkConf) extends Logging with ExecutorAllocationCli
878879 * (a-hdfs-path/part-nnnnn, its content)
879880 * }}}
880881 *
881- * @param minPartitions A suggestion value of the minimal splitting number for input data.
882- *
883882 * @note Small files are preferred; very large files may cause bad performance.
883+ * @note On some filesystems, `.../path/*` can be a more efficient way to read all files
884+ * in a directory rather than `.../path/` or `.../path`
885+ * @param minPartitions A suggestion value of the minimal splitting number for input data.
884886 */
885887 @ Experimental
886888 def binaryFiles (
You can’t perform that action at this time.
0 commit comments