8000 [autoscaler][logs] Improve status logging · Issue #26670 · ray-project/ray · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
[autoscaler][logs] Improve status logging #26670
Open
@DmitriGekhtman

Description

@DmitriGekhtman

Description

The "ray status" logs periodically emitted by the autoscaler have the following issues:

  • (biggest issue) They are emitted once per several seconds, even when the cluster status hasn't changed. This drowns out information about actual events and issues. Only log status when there is a change. The definition of "change" is TBD, but for a first cut, a literal change in the status string (ignoring timestamp) could probably work. This change should be accompanied by an info message and a feature flag to disable it.
  • (smaller issue) The logs are multi-line, i.e. they contain newline characters. That's bad for structured logging. We've had some complaints about this. Consider logging the status line-by-line.

Use case

Improved log-viewing experience.

Metadata

Metadata

Assignees

No one assigned

    Labels

    P1Issue that should be fixed within a few weeksRay-2.4enhancementRequest for new feature and/or capabilitygood-first-issueGreat starter issue for someone just starting to contribute to Rayinfraautoscaler, ray client, kuberay, related issuesobservabilityIssues related to the Ray Dashboard, Logging, Metrics, Tracing, and/or Profilingusability

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0