Comparison of acquisition functions in bayesian optimization
7 Ansichten (letzte 30 Tage)
Ältere Kommentare anzeigen
Aden Lee
am 29 Mai 2020
Beantwortet: Alan Weiss
am 1 Jun. 2020
From what i can see from various references, they said that expected improvement is most commonly used compared with other acquisition functions, such as probability of improvement and LCB (in-built function in matlab). Why is that so? (Concept question)
0 Kommentare
Akzeptierte Antwort
Alan Weiss
am 1 Jun. 2020
I am not an expert in this area, but I'll tell you what I know about acquisition function types. From what I understand, in internal testing it was found that 'expected-improvement-per-second-plus' (default) works well; the 'per second' attribute allows for faster model-building and optimization in some ways, and the 'plus' attribute avoids overexploiting an area (more search for a global minimum). The "probability of improvement" calculation does not take into account the amount of improvement, so is a simpler model, and as such I would expect it to do worse on reasonably smooth or predictable problems. The "lower confidence bound" is another function that ignores much information about a problem, so should perform worse when the problem is predictable or smooth. Conversely, if you have a very noisy or unpredictable problem, then maybe these insensitive acquisition functions would be more appropriate.
Just my 2 cents, I'm sure that an expert can give you more information.
Alan Weiss
MATLAB mathematical toolbox documentation
0 Kommentare
Weitere Antworten (0)
Siehe auch
Kategorien
Mehr zu Image Data Workflows finden Sie in Help Center und File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!