Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Precompute solution outputs #14

Open
cayhorstmann opened this issue May 27, 2022 · 1 comment
Open

Precompute solution outputs #14

cayhorstmann opened this issue May 27, 2022 · 1 comment

Comments

@cayhorstmann
Copy link
Owner

Right now, the solution outputs are compluted together with the student outputs. This is inefficient since they don't change. Instead, compute them when a problem is submitted and save them with the problem zip.

Because existing problems don't have the solutions, every problem zip needs to be tested for the presence of solutions. If they aren't present, add them and store the augmented file in S3, then run the student submission.

@cayhorstmann
Copy link
Owner Author

Also investigate if this can be used to give a firm score for "expected" style tests. Right now, if there is an exception in the student code, we don't get a correct partial score.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant