Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release additional pre-trained models (if available) #83

Open
BradMcDanel opened this issue Jun 17, 2020 · 0 comments
Open

Release additional pre-trained models (if available) #83

BradMcDanel opened this issue Jun 17, 2020 · 0 comments
Labels
enhancement New feature or request

Comments

@BradMcDanel
Copy link

First, thank you for this contribution and the release of code and pre-trained models. I have trained two of the smaller settings and get similar error rates to the released models.

In the MODEL_ZOO.md readme, you mention that "the reported errors are averaged across 5 reruns for robust estimates". If these additional models (5 models per setting) are saved somewhere and match the current codebase, it would be a valuable addition to what is currently released. For instance, research in ensemble methods or analysis in variations across models would benefit greatly from this contribution.

For the larger settings (e.g., RegNetX-32GF at 76 train hours for 8 GPUs), training 5 models would take over two weeks on 8 GPUs, making it difficult for most researchers to do. Thanks!

@rajprateek rajprateek added the enhancement New feature or request label Jun 20, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants