Website: Add blog post for 18.0.0 #547
Conversation
|
|
||
| ## R notes | ||
|
|
||
| For more on what’s in the 18.0.0 R package, see the [R changelog][4]. |
There was a problem hiding this comment.
@jonkeane @paleolimbot @assignUser can you help with the R notes?
Co-authored-by: David Li <li.davidm96@gmail.com> Co-authored-by: Rossi Sun <zanmato1984@gmail.com> Co-authored-by: Curt Hagenlocher <curt@hagenlocher.org>
| ## Linux packages notes | ||
|
|
||
| Azure file system is enabled. |
There was a problem hiding this comment.
Does this section really deserve being at the top?
There was a problem hiding this comment.
Ah, we can move this because this is not so important in 18.0.0.
This section was important in 17.0.0 because we dropped support for one platform: https://arrow.apache.org/blog/2024/07/16/17.0.0-release/
| ## Arrow Flight RPC notes | ||
|
|
||
| **Flight UCX is deprecated.** We plan to remove this experiment in the next couple of releases. |
There was a problem hiding this comment.
Flight UCX is C++ specific, this shouldn't be at the top of the release notes. The "Arrow Flight RPC notes" should be for Flight specification changes IMHO.
| ## R notes | ||
|
|
||
| For more on what’s in the 18.0.0 R package, see the [R changelog][4]. |
There was a problem hiding this comment.
| ## R notes | |
| For more on what’s in the 18.0.0 R package, see the [R changelog][4]. | |
| ## R notes | |
| * R functions that users write that use functions that Arrow supports in dataset | |
| queries now can be used in queries too. Previously, only functions that used | |
| arithmetic operators worked. | |
| For example, `time_hours <- function(mins) mins / 60` worked, | |
| but `time_hours_rounded <- function(mins) round(mins / 60)` did not; | |
| now both work. These are automatic translations rather than true user-defined | |
| functions (UDFs); for UDFs, see `register_scalar_function()`. [GH-41223](https://github.com/apache/arrow/issues/41223) | |
| * `mutate()` expressions can now include aggregations, such as `x - mean(x)`. [GH-41350](https://github.com/apache/arrow/issues/41350) | |
| * `summarize()` supports more complex expressions, and correctly handles cases | |
| where column names are reused in expressions. [GH-41223](https://github.com/apache/arrow/issues/41223) | |
| * The `na_matches` argument to the `dplyr::*_join()` functions is now supported. | |
| This argument controls whether `NA` values are considered equal when joining. [GH-41358](https://github.com/apache/arrow/issues/41358) | |
| * R metadata, stored in the Arrow schema to support round-tripping data between | |
| R and Arrow/Parquet, is now serialized and deserialized more strictly. | |
| This makes it safer to load data from files from unknown sources into R data.frames. [GH-41969](https://github.com/apache/arrow/issues/41969) | |
| * Turn on the S3 and ZSTD features by default for macOS. [GH-42210](https://github.com/apache/arrow/issues/42210) | |
| * Fix a bug in our implementation of `pull` on grouped datasets, it now | |
| returns the expected column. [GH-43172](https://github.com/apache/arrow/issues/43172) | |
| For full details of what’s in the 18.0.0 R package, see the [R changelog][4]. |
There was a problem hiding this comment.
@jonkeane these are the 17.0.0 changes though right?
Nic and I are working on a NEWS.md patch in apache/arrow#44496 and we can copy that in here in a bit.
Co-authored-by: Alenka Frim <AlenkaF@users.noreply.github.com>
|
|
||
| ## Community | ||
|
|
||
| Since the 17.0.0 release, JJJJJ has been invited to be committer. |
There was a problem hiding this comment.
Yes, I will update the number of commits and the new committers once we approve RC0
| * Non-cpu work has continued with [GH-43973](https://github.com/apache/arrow/issues/43973), | ||
| [GH-43728](https://github.com/apache/arrow/issues/43728), [GH-43727](https://github.com/apache/arrow/issues/43727), | ||
| [GH-43391](https://github.com/apache/arrow/issues/43391), | ||
| [GH-42222](https://github.com/apache/arrow/issues/42222) and | ||
| [GH-41665](https://github.com/apache/arrow/issues/41665). |
There was a problem hiding this comment.
I think just enumerating those issue links might not be that informative without more context (for someone reading this, you would have to click on all those links to have an idea what actually changed)
Co-authored-by: Bryce Mecum <petridish@gmail.com>
Co-authored-by: Bryce Mecum <petridish@gmail.com>
Release blog post for 18.0.0.
Issues on the milestone are here: https://github.com/apache/arrow/milestone/64