Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Grab Filter percentile option. #21

Open
scamille opened this issue Dec 20, 2017 · 2 comments
Open

Grab Filter percentile option. #21

scamille opened this issue Dec 20, 2017 · 2 comments
Assignees

Comments

@scamille
Copy link
Contributor

Suggestion:

Nappy - Today at 2:19 AM
i have a suggestion for autosimc/simc: I would like to specify for example percentile=75, to not optimze for mean dps but slightly favor higher variance solutions?(edited)
is this somehow possible already?

This is not yet possible, but should be relatively simple to add.

@scamille scamille self-assigned this Dec 20, 2017
@nyri
Copy link

nyri commented Dec 20, 2017

I will try to clarify on this using terms of an genetic algorithm:

So basically we have a set of profiles. For each profile we determine the fitness using simc with a predefined target error.
After we did this we have a selection process where we select all profiles with a fitness > max fitness - target error * 2 for the next stage.

My suggestion was NOT to change the selection process to always choose the top n% of profiles as an alternative to the target error method.
My idea was basically to change the fitness function to not use the mean dps output of simc, but for example mean + x * standard variance or said percentile based dps value.

My motivation behind that is that real life experience shows that players tend to favor options which might be a little bit worse on mean dps but better in for example in 25% of the pulls for parses. The opposite might be true for progression, where consistency is key.

@scamille
Copy link
Contributor Author

Thanks for clarifying.

As I wrote on Disc, the problem here is that I don't have any statistical measurement for the variance of the dps_percentile. The dps_error value only holds for the mean, based on central limit theorem.

This could be added with top_n grabbing, if that is still something you are interested in.

I personally don't want to encourage top_n grab method, exactly because it is statistically invalid to just rate profiles by their dps.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants