8000 Sink into table does not work with Kafka source · Issue #16135 · risingwavelabs/risingwave · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Sink into table does not work with Kafka source #16135

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
ly9chee opened this issue Apr 3, 2024 · 2 comments
Open

Sink into table does not work with Kafka source #16135

ly9chee opened this issue Apr 3, 2024 · 2 comments
Assignees
@shanicky
Labels
type/bug Type: Bug. Only for issues.
Milestone
release-2.5

Comments

@ly9chee
Copy link
Contributor
ly9chee commented Apr 3, 2024

Describe the bug

Here is an example of the create sink into document. It seems that the data in topic_0 has not been correctly written to orders table.

CREATE TABLE orders (
    id int primary key,
    price int,
    item_id int,
    customer_id int
);

CREATE source orders_s0 (
    id int,
    price int,
    item_id int,
    customer_id int
) WITH (
    connector = 'kafka',
    topic = 'topic_0',
    properties.bootstrap.server='127.0.0.1:9092',
    scan.startup.mode='earliest'
) FORMAT PLAIN ENCODE JSON;

CREATE SINK orders_sink0 INTO orders FROM orders_s0;

Write some data to topic_0

echo '{"id":1, "price": 20, "item_id":101, "customer_id":999}' | kcat -b 127.0.0.1:9092 -P -t topic_0

Then check the orders table

-- no results returned
select * from orders;

But CREATE MATERIALIZED VIEW worked as expected.

create materialized view orders_mv as select * from orders_s0;
dev=> select * from orders_mv;
 id | price | item_id | customer_id
----+-------+---------+-------------
  1 |    20 |     101 |         999

Error message/log

No response

To Reproduce

No response

Expected behavior

The data in topic_0 should be correctly sunk into the orders table.

How did you deploy RisingWave?

No response

The version of RisingWave

PostgreSQL 9.5.0-RisingWave-1.7.2 (6ecc083)

Additional context

No response
@ly9chee ly9chee added the type/bug Type: Bug. Only for issues. label Apr 3, 2024
@github-actions github-actions bot added this to the release-1.8 milestone Apr 3, 2024
@shanicky shanicky self-assigned this Apr 8, 2024
@xxchan xxchan mentioned this issue Apr 27, 2024
Closed
@shanicky shanicky modified the milestones: release-1.8, release-1.10 May 8, 2024
@shanicky shanicky modified the milestones: release-1.10, release-1.11 Jul 10, 2024
@shanicky shanicky modified the milestones: release-2.2, release-2.3 Dec 27, 2024
@xxchan
Copy link
Member
xxchan commented May 9, 2025

likely solved by #21665

Worth adding e2e tests:

  • sink (with/without connector) into table (with/without connector)

@BugenZhao
Copy link
Member

likely solved by #21665

Hmm.. I think it's more like #18356?

@xxchan xxchan mentioned this issue May 9, 2025
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@shanicky shanicky

Labels
type/bug Type: Bug. Only for issues.
Projects
None yet
Milestone
release-2.5
Development

No branches or pull requests
4 participants
@shanicky @BugenZhao @xxchan @ly9chee
0