You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Right now, the solution outputs are compluted together with the student outputs. This is inefficient since they don't change. Instead, compute them when a problem is submitted and save them with the problem zip.
Because existing problems don't have the solutions, every problem zip needs to be tested for the presence of solutions. If they aren't present, add them and store the augmented file in S3, then run the student submission.
The text was updated successfully, but these errors were encountered:
Also investigate if this can be used to give a firm score for "expected" style tests. Right now, if there is an exception in the student code, we don't get a correct partial score.
Right now, the solution outputs are compluted together with the student outputs. This is inefficient since they don't change. Instead, compute them when a problem is submitted and save them with the problem zip.
Because existing problems don't have the solutions, every problem zip needs to be tested for the presence of solutions. If they aren't present, add them and store the augmented file in S3, then run the student submission.
The text was updated successfully, but these errors were encountered: