-
Notifications
You must be signed in to change notification settings - Fork 360
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[GH-5670] Add Spark 3.5 support #5664
Conversation
The change looks good time, but please also make changes in :
and rebuild testing image |
Can create issue and link it with this pr? |
gradle-spark3.5.properties
Outdated
fabricK8sClientVersion=6.4.1 | ||
executorOverheadMemoryOption=spark.executor.memoryOverhead | ||
driverOverheadMemoryOption=spark.driver.memoryOverhead | ||
supportedPythonVersions=3.8 3.9 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think you will need to add Python 3.10 and 3.11
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM, thanks! I would great to build new image and run tests before we merge it.
* Add Spark 3.5 support * fix py docs * add py 3.10 3.11 * Update Docker Image Version * rowencoder expression encoder fix --------- Co-authored-by: h2o-ops <h2o-ops@h2o.ai> (cherry picked from commit 9713dfd)
closes #5670