订阅kafka动态匹配表名问题 #29270
ksdb1155228
started this conversation in
RFC
订阅kafka动态匹配表名问题
#29270
Replies: 1 comment
-
|
Is table exist in Doris? Using single stream to load multi table should promise all table exist.For example, load a data like: test|a,b,c. If test do not exist, load job will do no consume. |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
我创建的订阅任务,任务中指定单表insert \ update \delete 都没问题,但是不指定表名做动态匹配则无法消费kafka中消息。
请大佬们看看 是否我创建的任务语句有问题。
我创建的任务语句如下:
CREATE ROUTINE LOAD yunwei.test_kafka_032
WITH MERGE
DELETE ON crud = "d"
PROPERTIES
(
"format" = "json" ,
"desired_concurrent_number"="1",
"max_batch_interval" = "20",
"max_batch_rows" = "300000",
"max_batch_size" = "209715200",
"max_error_number" = "9999999999"
)
FROM KAFKA
(
"kafka_broker_list" = "10.4.33.234:9092",
"kafka_topic" = "testDorisKafkaTopic",
"property.group.id" = "test_kafka_group",
"property.client.id" = "test_kafka_client",
"property.kafka_default_offsets" = "OFFSET_BEGINNING"
)
发送的数据内容:
test_orders|{"id":0,"shop_code":"123456","shop_name":"测试店铺","order_id":666666666,"sku":"ABCD","quantity":8,"unit_price":88.88,"commit_time":"2023-12-29 09:42:39","crud":"r"}
查看任务的reason:
[INTERNAL_ERROR]empty data
0. /root/src/doris-2.0/be/src/common/stack_trace.cpp:302: StackTrace::tryCapture() @ 0x000000000ba1f197 in /opt/apache-doris-2.0.2-bin-x64/be/lib/doris_be
Beta Was this translation helpful? Give feedback.
All reactions