Skip to content

Commit 3c0824d

Browse files
committed
[SPARK-50711][PS][DOCS] Upgrade the minimum version of Pandas in PS to 2.2.0
### What changes were proposed in this pull request? Upgrade the minimum version of Pandas in PS to 2.2.0 But the version used in `require_minimum_pandas_version` is still 2.0.0, because currently this function is used in both PS and non-PS modules. ### Why are the changes needed? Actually, PS with Pandas < 2.2.0 has already been broken in master branch ### Does this PR introduce _any_ user-facing change? No, doc-only ### How was this patch tested? CI ### Was this patch authored or co-authored using generative AI tooling? No Closes apache#49344 from zhengruifeng/ps_pd_mini. Authored-by: Ruifeng Zheng <ruifengz@apache.org> Signed-off-by: Ruifeng Zheng <ruifengz@apache.org>
1 parent 5c63484 commit 3c0824d

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

dev/requirements.txt

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ py4j>=0.10.9.7
55
numpy>=1.21
66
pyarrow>=11.0.0
77
six==1.16.0
8-
pandas>=2.0.0
8+
pandas>=2.2.0
99
scipy
1010
plotly>=4.8
1111
mlflow>=2.3.1

python/docs/source/getting_started/install.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -239,7 +239,7 @@ Installable with ``pip install "pyspark[pandas_on_spark]"``.
239239
========= ================= ================================
240240
Package Supported version Note
241241
========= ================= ================================
242-
`pandas` >=2.0.0 Required for Pandas API on Spark
242+
`pandas` >=2.2.0 Required for Pandas API on Spark
243243
`pyarrow` >=11.0.0 Required for Pandas API on Spark
244244
========= ================= ================================
245245

0 commit comments

Comments
 (0)