Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GH-5670] Add Spark 3.5 support #5664

Merged
merged 6 commits into from
Oct 25, 2023
Merged

[GH-5670] Add Spark 3.5 support #5664

merged 6 commits into from
Oct 25, 2023

Conversation

krasinski
Copy link
Member

@krasinski krasinski commented Oct 3, 2023

closes #5670

@mn-mikke
Copy link
Collaborator

mn-mikke commented Oct 3, 2023

The change looks good time, but please also make changes in :

  • py-scoring/README.rst
  • py/README.rst

and rebuild testing image

@mn-mikke
Copy link
Collaborator

mn-mikke commented Oct 3, 2023

Can create issue and link it with this pr?

@krasinski krasinski added the next major release Goes into Major release label Oct 10, 2023
@krasinski krasinski changed the title Add Spark 3.5 support [GH-5670] Add Spark 3.5 support Oct 10, 2023
fabricK8sClientVersion=6.4.1
executorOverheadMemoryOption=spark.executor.memoryOverhead
driverOverheadMemoryOption=spark.driver.memoryOverhead
supportedPythonVersions=3.8 3.9
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think you will need to add Python 3.10 and 3.11

Copy link
Collaborator

@mn-mikke mn-mikke left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks! I would great to build new image and run tests before we merge it.

@krasinski krasinski merged commit 9713dfd into master Oct 25, 2023
2 of 3 checks passed
@krasinski krasinski deleted the add-spark-3-5-support branch October 25, 2023 16:01
ispringer referenced this pull request in evergage/sparkling-water Apr 11, 2024
* Add Spark 3.5 support

* fix py docs

* add py 3.10 3.11

* Update Docker Image Version

* rowencoder expression encoder fix

---------

Co-authored-by: h2o-ops <h2o-ops@h2o.ai>
(cherry picked from commit 9713dfd)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
next major release Goes into Major release
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Add Spark 3.5 support
2 participants