-
QuestionHello Everybody, I get datas from API and want to put those datas from API to memory, to enrich kafka datas with those data in memory. 2 type of source with 2 type of enrichment_tables memory configuration: -First source is as returned by debug: enrichment conf : -Second source is as returned by debug: enrichment conf : Everytime I try to remap matching "record, err = get_enrichment_table_record("cache_vector", { "key": MyAddress })", I finish with error "get_enrichment_table_record" at (263:336): Key not found" What format must I use to put data in memory? Thanks and best regards! Vector ConfigNo response Vector LogsNo response |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
Hello evreybody, the issue was : Looking inside the memory before the flush, so memory had nothing yet. to push data in memory I use this format: To look inside the memory : Now i must find a way to start kafka after memory has been enriched Have a good day. |
Beta Was this translation helpful? Give feedback.
Hello evreybody, the issue was : Looking inside the memory before the flush, so memory had nothing yet.
to push data in memory I use this format:
{Toto : {aaaa : aa, bbbb : bb, cccc : cc}}
it appear in memory with this format:
{"key":"Toto","source_type":"memory","timestamp":"2026-01-21T09:37:26.209090891Z","ttl":299,"value":{"aaaa":"aa","bbbb":"bb","cccc":"cc"}}
To look inside the memory :
[enrichment_tables.cache]
type = "memory"
ttl = 300
flush_interval = 5
inputs = ["results_to_memory"]
source_config.export_interval = 2
source_config.source_key = "memory_table_source"
[sinks.debug_cache]
type = "console"
target = "stdout"
inputs = ["memory_table_source"]
encoding.codec = "json"
Now i …