8000 support date/time.handling.mode for encode json source · Issue #16467 · risingwavelabs/risingwave · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

support date/time.handling.mode for encode json source #16467

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
xuefengze opened this issue Apr 24, 2024 · 2 comments
Open

support date/time.handling.mode for encode json source #16467

xuefengze opened this issue Apr 24, 2024 · 2 comments
Assignees
@xiangjinwu
Milestone
release-2.5

Comments

@xuefengze
Copy link
Contributor
xuefengze commented Apr 24, 2024 •
edited
Loading

kafka/mqtt-sink with format plain encode json output:

  • date -> from CE
  • time -> millisecond

while kafka/mqtt-cdc with format plain encode json will parse these types:

  • date -> from epoch
  • time -> microsecond
@github-actions github-actions bot added this to the release-1.9 milestone Apr 24, 2024
@xiangjinwu xiangjinwu mentioned this issue Apr 26, 2024
Open
@fuyufjh fuyufjh modified the milestones: release-1.9, release-1.10 May 14, 2024
@xiangjinwu xiangjinwu modified the milestones: release-1.10, release-1.11 Jul 10, 2024
@xiangjinwu xiangjinwu modified the milestones: release-2.1, release-2.2 Oct 17, 2024
@xxchan
Copy link
Member
xxchan commented Nov 26, 2024 •
edited
Loading

Just found that currently we can't do roundtrip rw -> kafka -> rw for Date because of the handling mode. 🤪

In source, it's days_since_unix_epoch. In sink, it's num_days_from_ce

@xiangjinwu
Copy link
Contributor

Just found that currently we can't do roundtrip rw -> kafka -> rw for Date because of the handling mode. 🤪

In source, it's days_since_unix_epoch. In sink, it's num_days_from_ce

These are just legacy "default"s that we have to be backward compatible with. Handling modes are intended to solve the problem and move to more meaningful defaults #13109

@xiangjinwu xiangjinwu modified the milestones: release-2.2, release-2.3 Jan 8, 2025
@xiangjinwu xiangjinwu modified the milestones: release-2.3, release-2.4 Apr 25, 2025
@BugenZhao BugenZhao modified the milestones: release-2.4, release-2.5 May 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@xiangjinwu xiangjinwu

Labels
None yet
Projects
None yet
Milestone
release-2.5
Development

No branches or pull requests
5 participants
@fuyufjh @xiangjinwu @BugenZhao @xxchan @xuefengze
0