8000 [Optimizers] Programmatic access to Optimizer's capabilities/requirements · Issue #119 · automl/neps · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

[Optimizers] Programmatic access to Optimizer's capabilities/requirements #119

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
eddiebergman opened 8000 this issue Jul 30, 2024 · 0 comments
Assignees
Labels
ci Something related to the CI system ux Something that would improve user experience

Comments

@eddiebergman
Copy link
Contributor

Right now, there's no way to programmatically know that an optimizer supports multi-fidelity, multi-objective, cost-awareness or requires priors to be set.

This makes parametrized testing quite difficult as a result. What would be ideal is that from SearchMapping, we can traverse through it and get the capabilities of the optimizer, preferabbly from cls.Supports.fidelity, cls.Supports.multi_objective, cls.Supports.priors`, etc...

This would also be useful for CLI and documentation purposes, as right now this would all require manual specification and given then umber of optimizers, this would lead to a lot of inconsistencies building up over time if we were to do it manually.

One partial issue is that we use partial in the SearchMapping, meaning that we would have to go partial._inner_function.Support.blah (or whatever its called). Not a huge issue unless the partial actually changes the capability of the optimizer.

@eddiebergman eddiebergman added this to the Optimizer Overhaul milestone Jul 30, 2024
@eddiebergman eddiebergman added ux Something that would improve user experience ci Something related to the CI system labels Jul 30, 2024
Meganton added a commit that referenced this issue Apr 5, 2025
…ts dataclass, starting #119 and in the process solving #120

Throws a lot of errors for using the Supports-attribute on the algorithms-functions directly. Maybe use wrappers?
WIP, does not yet handle custom optimizers.
@Meganton Meganton self-assigned this Apr 9, 2025
Meganton added a commit that referenced this issue Apr 28, 2025
Adds `ignore_fidelity` parameter across optimizers for flexible fidelity management
Introduces warnings and error handling for missing or unsupported fidelity/prior cases
Updates grid, random, and Bayesian sampling to respect fidelity settings
Improves test coverage for fidelity and prior requirements

Fixes #118, #119, #120
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci Something related to the CI system ux Something that would improve user experience
Projects
Status: No status
Development

No branches or pull requests

2 participants
0