Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

GH-44564: [Java][FlightSQL] Fix native libraries relocation #44565

Merged
merged 1 commit into from
Oct 30, 2024

Conversation

laurentgo
Copy link
Collaborator

@laurentgo laurentgo commented Oct 29, 2024

Rationale for this change

Prefix used by native libraries shipped in the JDBC driver do not match the prefix used by Netty NativeLibraryLoader class, preventing them to be detected and loaded.

What changes are included in this PR?

Change the prefix of the libraries and add a integration test to verify the libraries are loaded

Also exclude several group of data which are not properly relocated and may cause conflict with existing classpath.

Are these changes tested?

Yes, new test added for checking the native library loader

Are there any user-facing changes?

No

Prefix used by native libraries shipped in the JDBC driver do not match
the prefix used by Netty `NativeLibraryLoader` class, preventing them to
be detected and loaded.

Change the prefix of the libraries and add a integration test to verify
the libraries are loaded

Also exclude several group of data which are not properly relocated and
may cause conflict with existing classpath.
@laurentgo
Copy link
Collaborator Author

@github-actions crossbow submit -g java

Copy link

Revision: 16824ca

Submitted crossbow builds: ursacomputing/crossbow @ actions-6b353f850c

Task Status
java-jars GitHub Actions
test-conda-python-3.11-spark-master GitHub Actions
verify-rc-source-java-linux-almalinux-8-amd64 GitHub Actions
verify-rc-source-java-linux-conda-latest-amd64 GitHub Actions
verify-rc-source-java-linux-ubuntu-20.04-amd64 GitHub Actions
verify-rc-source-java-linux-ubuntu-22.04-amd64 GitHub Actions
verify-rc-source-java-macos-amd64 GitHub Actions

@laurentgo
Copy link
Collaborator Author

@github-actions crossbow submit java-jars

Copy link

Revision: 16824ca

Submitted crossbow builds: ursacomputing/crossbow @ actions-051991ec49

Task Status
java-jars GitHub Actions


/** Check that relocated netty code can also load matching native library. */
@Test
@Timeout(value = 2, unit = TimeUnit.MINUTES)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does this need the timeout?

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not really, I copied the pattern from the other test method (which also does not really need a test timeout as well)

@github-actions github-actions bot added awaiting merge Awaiting merge and removed awaiting review Awaiting review labels Oct 30, 2024
@lidavidm lidavidm merged commit 3217fc2 into apache:main Oct 30, 2024
16 checks passed
@lidavidm lidavidm removed the awaiting merge Awaiting merge label Oct 30, 2024
Copy link

After merging your PR, Conbench analyzed the 3 benchmarking runs that have been run so far on merge-commit 3217fc2.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details. It also includes information about 3 possible false positives for unstable benchmarks that are known to sometimes produce them.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants