[SPARK-45994][PYTHON][3.4] Change description-file to description_file

[bjornjorgensen]

What changes were proposed in this pull request?

Change description-file to description_file

Why are the changes needed?

./dev/make-distribution.sh --name custom-spark --pip -Pkubernetes > output.txt 2>&1
in the file there is this

+ echo 'Building python distribution package'
Building python distribution package
+ pushd /home/bjorn/spark/python
+ rm -rf pyspark.egg-info
+ python3 setup.py sdist
/usr/lib/python3.11/site-packages/setuptools/dist.py:745: SetuptoolsDeprecationWarning: Invalid dash-separated options
!!

        ********************************************************************************
        Usage of dash-separated 'description-file' will not be supported in future
        versions. Please use the underscore name 'description_file' instead.

        This deprecation is overdue, please update your project and remove deprecated
        calls to avoid build errors in the future.

        See https://setuptools.pypa.io/en/latest/userguide/declarative_config.html for details.
        ********************************************************************************

!!
  opt = self.warn_dash_deprecation(opt, section)
running sdist
running egg_info

Does this PR introduce any user-facing change?

No.

How was this patch tested?

Pass GA

Was this patch authored or co-authored using generative AI tooling?

No.

[drsnyder]

Should that option be removed entirely? It doesn't appear to be supported (doc, related).

[bjornjorgensen]

well, it is what those that are making the program recommend. And there are many other that get the same message like google/sentencepiece#740

[bjornjorgensen]

4) Spark 3.4.4: Released on October 27, 2024. This will be the final maintenance release for the 3.4 series.

so I will close this on.

[bjornjorgensen]

SO Does description-file in setup.cfg, section "metadata" have any effect? But I don't wanna change something with this only make it build. I think there can be another PR where we change it.