Replies: 2 comments 8 replies
-
|
Hi @lzwaan , Yes you could use the |
Beta Was this translation helpful? Give feedback.
-
|
Thank you for the quick reply. Is there a specific way for vector/rust how to create the description file? Because when i created one with protoc, vector was complaining about the format, do you maybe have a example command to do it correctly? |
Beta Was this translation helpful? Give feedback.
-
|
Can you share what you tried? I haven't actually tried to use this feature yet so I'm not sure exactly how the desc file is expected to be generated. You can see some example desc files that were added with the implementation: https://github.com/vectordotdev/vector/pull/18019/files#diff-f8ae81252cbe11d856362cb940fee1d887d24529704764ea37e44fd304b0c766 . If you are more familiar with protobuf than I am maybe something will jump out to you. |
Beta Was this translation helpful? Give feedback.
-
|
given a proto file named cd /var/protobuf # folder contains test_protobuf.proto
protoc -o /var/protobuf/test_protobuf.desc test_protobuf.proto --include_importsEdit: added your vector's config file should look something like the following: [sources.my_kafka_protobuf]
type = "kafka"
bootstrap_servers = "localhost:9092"
group_id = "consumer-group-name"
topics = [ "protobuf_topic" ]
[sources.my_kafka_protobuf.decoding]
codec = "protobuf"
[sources.my_kafka_protobuf.decoding.protobuf]
desc_file = "/var/protobuf/test_protobuf.desc"
message_type = "test_protobuf.Person"
[sinks.my_sink_id]
type = "console"
inputs = [ "my_kafka_protobuf" ]
target = "stdout"
[sinks.my_sink_id.encoding]
codec = "json"hope this helps. |
Beta Was this translation helpful? Give feedback.
-
|
I have no idea what i should change/do. Or is it not possible to load multiple proto files in the description file? Below some steps to before running vector: I get the following error: These are my commands before it try to start vector: This is a the head of file: telemetry_top.proto which has an import statement: This are all the protofiles i need to use, it's a long list but maybe needed for the troubleshouting: |
Beta Was this translation helpful? Give feedback.
-
|
please try to add protoc -I=/etc/vector/junos-telemetry-interface/ --include_imports telemetry_top.proto -o junos-telemetry-interface/telemetry.desc |
Beta Was this translation helpful? Give feedback.
-
|
Thank Daniel almost there, the proto compiler works but now i receive some strange error?? |
Beta Was this translation helpful? Give feedback.
-
|
Do you get this error during startup phase or during receiving a message from your source? |
Beta Was this translation helpful? Give feedback.
-
|
Vector is starting up fine, the errors are shown when the messages arrive at the input. |
Beta Was this translation helpful? Give feedback.
-
|
can you store the |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
Is it possible to use UDP as source and to decode (juniper) protobuf messages?
Beta Was this translation helpful? Give feedback.
All reactions