[Optimizers] Programmatic access to Optimizer's capabilities/requirements · Issue #119 · automl/neps · GitHub
More Web Proxy on the site http://driver.im/
You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Right now, there's no way to programmatically know that an optimizer supports multi-fidelity, multi-objective, cost-awareness or requires priors to be set.
This makes parametrized testing quite difficult as a result. What would be ideal is that from SearchMapping, we can traverse through it and get the capabilities of the optimizer, preferabbly from cls.Supports.fidelity, cls.Supports.multi_objective, cls.Supports.priors`, etc...
This would also be useful for CLI and documentation purposes, as right now this would all require manual specification and given then umber of optimizers, this would lead to a lot of inconsistencies building up over time if we were to do it manually.
One partial issue is that we use partial in the SearchMapping, meaning that we would have to go partial._inner_function.Support.blah (or whatever its called). Not a huge issue unless the partial actually changes the capability of the optimizer.
The text was updated successfully, but these errors were encountered:
…ts dataclass, starting #119 and in the process solving #120
Throws a lot of errors for using the Supports-attribute on the algorithms-functions directly. Maybe use wrappers?
WIP, does not yet handle custom optimizers.
Adds `ignore_fidelity` parameter across optimizers for flexible fidelity management
Introduces warnings and error handling for missing or unsupported fidelity/prior cases
Updates grid, random, and Bayesian sampling to respect fidelity settings
Improves test coverage for fidelity and prior requirements
Fixes#118, #119, #120
Right now, there's no way to programmatically know that an optimizer supports multi-fidelity, multi-objective, cost-awareness or requires priors to be set.
This makes parametrized testing quite difficult as a result. What would be ideal is that from
SearchMapping
, we can traverse through it and get the capabilities of the optimizer, preferabbly fromcls.Supports.fidelity
,cls.Supports.multi_objective
, cls.Supports.priors`, etc...This would also be useful for CLI and documentation purposes, as right now this would all require manual specification and given then umber of optimizers, this would lead to a lot of inconsistencies building up over time if we were to do it manually.
One
partial
issue is that we usepartial
in theSearchMapping
, meaning that we would have to gopartial._inner_function.Support.blah
(or whatever its called). Not a huge issue unless the partial actually changes the capability of the optimizer.The text was updated successfully, but these errors were encountered: