-
Notifications
You must be signed in to change notification settings - Fork 21
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
openAlexR in and parallel::mclapply()
: Multicore API cores fail when no single core API call was issued before.
#189
Comments
This is an interaction between {progress} and {parallel}. We use {progress} to print the progress bar, and the progress bar is stateful - I don't know the internals of {parallel}, but my suspicion is that you have a race condition with each thread updating the same progress state. I think this should go away if you disable the progress bar, but now I also realize that Lines 369 to 378 in 32855b6
|
@yjunechoe you're right. |
Thanks for looking into this - I will try it out as soon as it is changed. |
So it looks like |
Yeah I think that'd be safest! |
Unfortunately, this did not solve the issue. I installed from github It it still crashes:
Just to be sure, I used |
OK - the problem is upstream in
and it is independent of https://community.rstudio.com/t/running-parallel-on-mac/142580/6 (although I don't know if it only affect M1 Macs). I filed a bug at r-lib/httr#749. I do not know if the error occurs on Intel Macs, Windows or Linux - I have a M1 Mac. It also occurs in
|
Hi
I am using
parallel::mclapply()
to make parallel API calls and these fail, when not a single core has been issued before:The error message is:
It might be necessary to have a OpenAlex Premium key for testing.
But if you have an idea, I would be happy to test.
The text was updated successfully, but these errors were encountered: