8000 log/fluent_client prints errors when log lines are too long · Issue #135610 · cockroachdb/cockroach · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
log/fluent_client prints errors when log lines are too long #135610
Open
@kyle-a-wong

Description

@kyle-a-wong

The following error can be seen when the fluentd client attempts to write a message that is too big: write: message too long or short write and can be attributed to this line of code.

Specifically, this has been observed when eventpb.QueryExecute events are logged with large placeholder values, resulting in conn.Write in fluent_client.go to error. To fix, I see two potential options:

  1. Add some truncation logic to truncate the data in these events if they are too big
  2. Break the fluent sink writes up into small chunks to avoid message too long errors.

Jira issue: CRDB-44655

Metadata

Metadata

Assignees

No one assigned

    Labels

    C-bugCode not up to spec/doc, specs & docs deemed correct. Solution expected to change code/behavior.T-observabilitybackport-23.2.xFlags PRs that need to be backported to 23.2.backport-24.1.xFlags PRs that need to be backported to 24.1.backport-24.3.xFlags PRs that need to be backported to 24.3branch-masterFailures and bugs on the master branch.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      0