Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A script that converts the data for sqlite3 use #25

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

kristopolous
Copy link

This addresses #24.

It takes the schema.sql and has it rewritten inline in a bash script.

Then as sqlite3 doesn't seem to like giant inserts, there's a secondary process that breaks up the inserts into a number of files in a temp directory and then processes them one by one ... cleaning up the temp directory at the end.

@kristopolous
Copy link
Author

Also it's worth noting that select count(*) from VehicleModelYear; matches ... so I don't believe I'm excluding anything.

@kristopolous
Copy link
Author

It's worth noting that albeit more complex, this method, as opposed to just a data dump is robust to modifying only one copy of the data and doesn't double the work.

Of course if the schema changes this would too, yes sure... But that schema looks pretty stable while new cars (data change) is expected effectively for perpetuity.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant