Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rs test git branch #7

Open
wants to merge 8 commits into
base: master
Choose a base branch
from
Open

Rs test git branch #7

wants to merge 8 commits into from

Conversation

sfc-gh-rsreenivasan
Copy link
Collaborator

  1. Merged Mei's Version which includes a new switch called DR. This switch can be used to execute generated SQL Files in Target Account
  2. Refactored the code to execute files using python connector's execute_stream function and added continue_on_error option
  3. Added the ability to execute sql files in parallel threads using multithreading instead of multi-processing as metadata operations generally are slow and to avoid client-side out of memory errors
  4. Added query_tag for executed sql statements
  5. Enhanced retry_failed_statements by adding query_tag with filenames and also captured errors with query_ids in logs
    Added
  6. Added the ability to provide list of files that can be split by lines while executing in parallel

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@sfc-gh-myang sfc-gh-myang Awaiting requested review from sfc-gh-myang

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@sfc-gh-rsreenivasan @rengasreeniv