Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix(csharp/src/Drivers/Apache): fix to workaround concurrency issue #2282

Conversation

birschick-bq
Copy link
Contributor

@birschick-bq birschick-bq commented Oct 28, 2024

Provides an interim work-around for the concurrency issue identified in #2280.

  • Removes the SQL DELETE statements from the SQL table scripts.
  • Uses the XUnit.Collection to serialize the execution of ClientTests and DriverTests.
  • Fixes the missing application of HttpRequestTimeout due to an incomplete implementation of the ValidateOptions in SparkDatabricksConnection.
  • Improve table create table syntax to CREATE OR REPLACE TABLE to reduce probably of inconsistent state.

Note: this is not the final solution. A more robust isolation of table creation needs to done to isolate concurrency.

@birschick-bq birschick-bq marked this pull request as ready for review October 29, 2024 16:57
@github-actions github-actions bot added this to the ADBC Libraries 15 milestone Oct 29, 2024
Copy link
Contributor

@CurtHagenlocher CurtHagenlocher left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! Just a few typos in comments that would be good to fix.

@@ -30,8 +30,12 @@ namespace Apache.Arrow.Adbc.Tests.Drivers.Apache.Spark
/// <remarks>
/// Tests are ordered to ensure data is created for the other
/// queries to run.
/// <para>Note: This test create/replaces the table identified in the configuration (metadata/table).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: creates

@@ -30,8 +30,12 @@ namespace Apache.Arrow.Adbc.Tests.Drivers.Apache.Spark
/// <remarks>
/// Tests are ordered to ensure data is created for the other
/// queries to run.
/// <para>Note: This test create/replaces the table identified in the configuration (metadata/table).
/// It uses the test collection "TableCreateTestCollection" to ensure it does not run
/// as the same time as any other tests that may create/udate the same table.</para>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: update

@@ -36,8 +36,12 @@ namespace Apache.Arrow.Adbc.Tests.Drivers.Apache.Spark
/// <remarks>
/// Tests are ordered to ensure data is created for the other
/// queries to run.
/// <para>Note: This test create/replaces the table identified in the configuration (metadata/table).
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: creates

@@ -36,8 +36,12 @@ namespace Apache.Arrow.Adbc.Tests.Drivers.Apache.Spark
/// <remarks>
/// Tests are ordered to ensure data is created for the other
/// queries to run.
/// <para>Note: This test create/replaces the table identified in the configuration (metadata/table).
/// It uses the test collection "TableCreateTestCollection" to ensure it does not run
/// as the same time as any other tests that may create/udate the same table.</para>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

nit: update

@birschick-bq birschick-bq changed the title fix(csharp/src/Drivers/Apache): interim fix to workaround concurrency issue fix(csharp/src/Drivers/Apache): fix to workaround concurrency issue Oct 29, 2024
@CurtHagenlocher CurtHagenlocher merged commit 99e7e53 into apache:main Oct 29, 2024
7 checks passed
@birschick-bq birschick-bq deleted the dev/birschick-bq/concurrency-work-around branch November 1, 2024 18:02
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants