8000 [RLlib] (PPO) algo parameter "lambda_" never gets passed because `AlgorithmConfig` refractored "lambda_" to "lambda" · Issue #30143 · ray-project/ray · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
[RLlib] (PPO) algo parameter "lambda_" never gets passed because AlgorithmConfig refractored "lambda_" to "lambda"  #30143
Open
@spacegoing

Description

@spacegoing

What happened + What you expected to happen

Screen Shot 2022-11-10 at 00 26 12

I am not sure if this is a bug or my workflow is wrong. I currently initialized a PPOConfig object. PPO only accepts lambda_ not lambda, but it never assigns lambda_ to self.lambda_, and AlgorithmConfig will always refract lambda_ to lambda, and there are no argument in AlgorithmConfig for specifying lambda_. As a result, there is no way for tune to tune lambda_ or lambda.

Versions / Dependencies

ray 2.0.0

Reproduction script

As above

Issue Severity

High: It blocks me from completing my task.

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Important issue, but not time-criticalbugSomething that is supposed to be working; but isn'tpending-cleanupThis issue is pending cleanup. It will be removed in 2 weeks after being assigned.rllibRLlib related issuesRLlib related issues

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0