Skip to content

Commit 98ca3ea

Browse files
bjornjorgensenericm-db
authored andcommitted
[SPARK-47151][PYTHON][PS][BUILD] Upgrade to pandas 2.2.1
### What changes were proposed in this pull request? Upgrade pandas from 2.2.0 to 2.2.1 ### Why are the changes needed? [Release notes 2.2.1](https://pandas.pydata.org/docs/whatsnew/v2.2.1.html) ### Does this PR introduce _any_ user-facing change? No. ### How was this patch tested? Pass GA ### Was this patch authored or co-authored using generative AI tooling? No. Closes apache#45236 from bjornjorgensen/pandas2.2.1. Authored-by: Bjørn Jørgensen <[email protected]> Signed-off-by: Dongjoon Hyun <[email protected]>
1 parent 7466e83 commit 98ca3ea

File tree

2 files changed

+3
-3
lines changed

2 files changed

+3
-3
lines changed

Diff for: dev/infra/Dockerfile

+2-2
Original file line numberDiff line numberDiff line change
@@ -91,10 +91,10 @@ RUN mkdir -p /usr/local/pypy/pypy3.8 && \
9191
ln -sf /usr/local/pypy/pypy3.8/bin/pypy /usr/local/bin/pypy3.8 && \
9292
ln -sf /usr/local/pypy/pypy3.8/bin/pypy /usr/local/bin/pypy3
9393
RUN curl -sS https://bootstrap.pypa.io/get-pip.py | pypy3
94-
RUN pypy3 -m pip install numpy 'six==1.16.0' 'pandas<=2.2.0' scipy coverage matplotlib lxml
94+
RUN pypy3 -m pip install numpy 'six==1.16.0' 'pandas<=2.2.1' scipy coverage matplotlib lxml
9595

9696

97-
ARG BASIC_PIP_PKGS="numpy pyarrow>=15.0.0 six==1.16.0 pandas<=2.2.0 scipy plotly>=4.8 mlflow>=2.8.1 coverage matplotlib openpyxl memory-profiler>=0.61.0 scikit-learn>=1.3.2"
97+
ARG BASIC_PIP_PKGS="numpy pyarrow>=15.0.0 six==1.16.0 pandas<=2.2.1 scipy plotly>=4.8 mlflow>=2.8.1 coverage matplotlib openpyxl memory-profiler>=0.61.0 scikit-learn>=1.3.2"
9898
# Python deps for Spark Connect
9999
ARG CONNECT_PIP_PKGS="grpcio==1.59.3 grpcio-status==1.59.3 protobuf==4.25.1 googleapis-common-protos==1.56.4"
100100

Diff for: python/pyspark/pandas/supported_api_gen.py

+1-1
Original file line numberDiff line numberDiff line change
@@ -38,7 +38,7 @@
3838
MAX_MISSING_PARAMS_SIZE = 5
3939
COMMON_PARAMETER_SET = {"kwargs", "args", "cls"}
4040
MODULE_GROUP_MATCH = [(pd, ps), (pdw, psw), (pdg, psg)]
41-
PANDAS_LATEST_VERSION = "2.2.0"
41+
PANDAS_LATEST_VERSION = "2.2.1"
4242

4343
RST_HEADER = """
4444
=====================

0 commit comments

Comments
 (0)