First alpha release of PowerDNS DNSdist 2.0.0

[rgacogne]

https://blog.powerdns.com/2025/03/18/first-alpha-release-of-powerdns-dnsdist-2.0.0

[dmachard]

Great new !

[paddg]

I tried a first build on Opensuse Buildservice. Unfortunately generating the Cargo vendor.tar.xz failed:

$ osc service manualrun
Running source_service 'cargo_vendor' ...
2025-03-19T14:20:28.592262Z  INFO cargo_vendor: 🎢 Starting OBS Service Cargo Vendor.
2025-03-19T14:20:28.592270Z  WARN cargo_vendor: ⚠️  Cargo Vendor has been rewritten in rust!
2025-03-19T14:20:28.592368Z  INFO obs_service_cargo::utils: 🍿 Vendoring for src 'dnsdist-2.0.0-alpha1.tar.xz'
2025-03-19T14:20:28.736047Z  INFO obs_service_cargo::utils: 📗 Project does not use a workspace!
2025-03-19T14:20:28.736076Z  INFO obs_service_cargo::vendor: ⏫ Updating dependencies before vendor
2025-03-19T14:20:29.108567Z  INFO obs_service_cargo::vendor: ⏫ Successfully ran cargo update
2025-03-19T14:20:29.109012Z ERROR obs_service_cargo::audit: cargo_lock_err=Parse("parse error: invalid Cargo.lock format version: `4`\n")
2025-03-19T14:20:29.109037Z ERROR obs_service_cargo::utils: Unable to complete cargo audit rustsec_err=Error { kind: BadParam, msg: "parse error: parse error: invalid Cargo.lock format version: `4`\n", source: None }
2025-03-19T14:20:29.109043Z ERROR obs_service_cargo::cli: err=kind: cargo audit process failed
reason: Unable to complete cargo audit
2025-03-19T14:20:29.116587Z ERROR cargo_vendor: kind: cargo vendor process failed
...

But if I replace the

version = 4

line in dnsdist-rust-lib/rust/Cargo.lock by

version = 3

it works:

$ osc service manualrun
Running source_service 'cargo_vendor' ...
2025-03-19T14:25:50.100325Z  INFO cargo_vendor: 🎢 Starting OBS Service Cargo Vendor.
2025-03-19T14:25:50.100336Z  WARN cargo_vendor: ⚠️  Cargo Vendor has been rewritten in rust!
2025-03-19T14:25:50.100433Z  INFO obs_service_cargo::utils: 🍿 Vendoring for src 'dnsdist-2.0.0-alpha1.tar.xz'
2025-03-19T14:25:50.241013Z  INFO obs_service_cargo::utils: 📗 Project does not use a workspace!
2025-03-19T14:25:50.241070Z  INFO obs_service_cargo::vendor: ⏫ Updating dependencies before vendor
2025-03-19T14:25:50.595928Z  INFO obs_service_cargo::vendor: ⏫ Successfully ran cargo update
2025-03-19T14:25:50.596380Z  INFO obs_service_cargo::audit: 🎉 Cargo audit passed!
2025-03-19T14:25:51.367997Z  INFO obs_service_cargo::vendor: 📦 Archiving vendored dependencies...
2025-03-19T14:25:58.212170Z  INFO obs_service_cargo::cli: 🥳 ✨ Successfull ran OBS Service Cargo Vendor ✨

But then compilation fails:

[  108s] g++-11 -std=c++17 -DHAVE_CONFIG_H -I.  -I. -I. -pthread   -I/usr/include/luajit-5_1-2.1 -I/usr/include/editline   -I./ext/yahttp    -I./ext/protozero/include -I./dnsdist-rust-lib -I./dnsdist-rust-lib -I./dnsdist-rust-lib/rust/src -DSYSCONFDIR=\"/etc/dnsdist\" -DBOOST_CONTAINER_USE_STD_EXCEPTIONS -pthread -std=c++17 -DOPENSSL_LOAD_CONF -I/usr/include/p11-kit-1    -DOPENSSL_LOAD_CONF -I/usr/include/p11-kit-1     -fPIE -DPIE -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 --param ssp-buffer-size=4 -fstack-protector -g -O3 -Wall -Wextra -Wshadow -Wmissing-declarations -Wredundant-decls -fvisibility=hidden -fmessage-length=0 -grecord-gcc-switches -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector-strong -funwind-tables -fasynchronous-unwind-tables -fstack-clash-protection -g -c -o dnsdist-configuration.o dnsdist-configuration.cc
[  109s] dnsdist-configuration-yaml.cc: In function 'std::shared_ptr<dnsdist::rust::settings::DNSActionWrapper> dnsdist::rust::settings::getKeyValueStoreLookupAction(const dnsdist::rust::settings::KeyValueStoreLookupActionConfiguration&)':
[  109s] dnsdist-configuration-yaml.cc:1384:35: error: 'getKeyValueStoreLookupAction' is not a member of 'dnsdist::actions'; did you mean 'dnsdist::rust::settings::getKeyValueStoreLookupAction'?
[  109s]  1384 |   auto action = dnsdist::actions::getKeyValueStoreLookupAction(kvs, lookupKey, std::string(config.destination_tag));
[  109s]       |                                   ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
[  109s] dnsdist-configuration-yaml.cc:1374:35: note: 'dnsdist::rust::settings::getKeyValueStoreLookupAction' declared here
[  109s]  1374 | std::shared_ptr<DNSActionWrapper> getKeyValueStoreLookupAction(const KeyValueStoreLookupActionConfiguration& config)
[  109s]       |                                   ^~~~~~~~~~~~~~~~~~~~~~~~~~~~
[  109s] dnsdist-configuration-yaml.cc: In function 'std::shared_ptr<dnsdist::rust::settings::DNSActionWrapper> dnsdist::rust::settings::getKeyValueStoreRangeLookupAction(const dnsdist::rust::settings::KeyValueStoreRangeLookupActionConfiguration&)':
[  109s] dnsdist-configuration-yaml.cc:1398:35: error: 'getKeyValueStoreRangeLookupAction' is not a member of 'dnsdist::actions'; did you mean 'dnsdist::rust::settings::getKeyValueStoreRangeLookupAction'?
[  109s]  1398 |   auto action = dnsdist::actions::getKeyValueStoreRangeLookupAction(kvs, lookupKey, std::string(config.destination_tag));
[  109s]       |                                   ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[  109s] dnsdist-configuration-yaml.cc:1388:35: note: 'dnsdist::rust::settings::getKeyValueStoreRangeLookupAction' declared here
[  109s]  1388 | std::shared_ptr<DNSActionWrapper> getKeyValueStoreRangeLookupAction(const KeyValueStoreRangeLookupActionConfiguration& config)
[  109s]       |                                   ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
[  109s] dnsdist-configuration-yaml.cc: In function 'void dnsdist::rust::settings::registerKVSObjects(const dnsdist::rust::settings::KeyValueStoresConfiguration&)':
[  109s] dnsdist-configuration-yaml.cc:1609:8: warning: unused variable 'createObjects' [-Wunused-variable]
[  109s]  1609 |   bool createObjects = !dnsdist::configuration::yaml::s_inClientMode && !dnsdist::configuration::yaml::s_inConfigCheckMode;
[  109s]       |        ^~~~~~~~~~~~~
[  109s] dnsdist-configuration-yaml.cc:1607:60: warning: unused parameter 'config' [-Wunused-parameter]
[  109s]  1607 | void registerKVSObjects(const KeyValueStoresConfiguration& config)
[  109s]       |                         ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~
[  111s] make[2]: *** [Makefile:1932: dnsdist-configuration-yaml.o] Error 1
[  111s] make[2]: *** Waiting for unfinished jobs....
[  111s] make[2]: Leaving directory '/home/abuild/rpmbuild/BUILD/dnsdist-2.0.0-alpha1'
[  111s] make[1]: *** [Makefile:2075: all-recursive] Error 1
[  111s] make[1]: Leaving directory '/home/abuild/rpmbuild/BUILD/dnsdist-2.0.0-alpha1'
[  111s] make: *** [Makefile:1616: all] Error 2
[  111s] error: Bad exit status from /var/tmp/rpm-tmp.ASw5ry (%build)
[  111s] 
[  111s] 
[  111s] RPM build errors:
[  111s]     Bad exit status from /var/tmp/rpm-tmp.ASw5ry (%build)
[  111s] 
[  111s] node10 failed "build dnsdist.spec" at Wed Mar 19 14:49:36 UTC 2025.

[rgacogne]

Thanks! It looks like the YAML configuration code is not properly checking that we have either LMDB or CDB support enabled, I'll fix it.

[paddg]

I managed to solve the problem with the Cargo Lock versions by updating the Rust/Cargo tools.

[paddg]

I've tried building now with your patch. The former error has disappeared, thanks! But now I have a new one:

 ...
[  368s] /bin/sh ./libtool  --tag=CXX   --mode=link g++-11 -std=c++17  -fPIE -DPIE -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 --param ssp-buffer-size=4 -fstack-protector -g -O3 -Wall -Wextra -Wshadow -Wmissing-declarations -Wredundant-decls -fvisibility=hidden -fmessage-length=0 -grecord-gcc-switches -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector-strong -funwind-tables -fasynchronous-unwind-tables -fstack-clash-protection -g  -pie  -pthread -Wl,-z -Wl,relro -Wl,-z -Wl,now  -rdynamic -o dnsdist bpf-filter.o capabilities.o channel.o coverage.o credentials.o dns.o dnscrypt.o dnsdist-actions-factory.o dnsdist-actions.o dnsdist-async.o dnsdist-backend.o dnsdist-cache.o dnsdist-carbon.o dnsdist-configuration-yaml.o dnsdist-configuration.o dnsdist-console.o dnsdist-crypto.o dnsdist-discovery.o dnsdist-dnscrypt.o dnsdist-dnsparser.o dnsdist-dnsquestion.o dnsdist-doh-common.o dnsdist-dynblocks.o dnsdist-dynbpf.o dnsdist-ecs.o dnsdist-edns.o dnsdist-frontend.o dnsdist-healthchecks.o dnsdist-idstate.o dnsdist-internal-queries.o dnsdist-kvs.o dnsdist-lbpolicies.o dnsdist-lua-actions.o dnsdist-lua-bindings-dnscrypt.o dnsdist-lua-bindings-dnsparser.o dnsdist-lua-bindings-dnsquestion.o dnsdist-lua-bindings-kvs.o dnsdist-lua-bindings-network.o dnsdist-lua-bindings-packetcache.o dnsdist-lua-bindings-protobuf.o dnsdist-lua-bindings-rings.o dnsdist-lua-bindings.o dnsdist-lua-configuration-items.o dnsdist-lua-ffi.o dnsdist-lua-hooks.o dnsdist-lua-inspection-ffi.o dnsdist-lua-inspection.o dnsdist-lua-network.o dnsdist-lua-rules.o dnsdist-lua-vars.o dnsdist-lua-web.o dnsdist-lua.o dnsdist-mac-address.o dnsdist-metrics.o dnsdist-protobuf.o dnsdist-protocols.o dnsdist-proxy-protocol.o dnsdist-query-count.o dnsdist-random.o dnsdist-resolver.o dnsdist-rings.o dnsdist-rule-chains.o dnsdist-rules.o dnsdist-secpoll.o dnsdist-self-answers.o dnsdist-session-cache.o dnsdist-snmp.o dnsdist-svc.o dnsdist-systemd.o dnsdist-tcp-downstream.o dnsdist-tcp.o dnsdist-web.o dnsdist-xsk.o dnsdist.o dnslabeltext.o dnsname.o dnsparser.o dnstap.o dnswriter.o doh3.o dolog.o ednscookies.o ednsextendederror.o ednsoptions.o ednssubnet.o ext/json11/json11.o fstrm_logger.o gettime.o iputils.o libssl.o misc.o pollmplexer.o protozero.o proxy-protocol.o qtype.o remote_logger.o remote_logger_pool.o snmp-agent.o statnode.o svc-records.o tcpiohandler.o threadname.o uuid-utils.o xsk.o  ipcipher.o   dnsdist-nghttp2-in.o dnsdist-nghttp2.o   dnsdist-rust-lib/dnsdist-configuration-yaml-items-generated.o   epollmplexer.o   -lluajit-5.1 -ledit  ./ext/yahttp/yahttp/libyahttp.la -lsodium -lfstrm -lsystemd   ./ext/ipcrypt/libipcrypt.la ./ext/arc4random/libarc4random.la  -pthread -lre2 -lssl   -lcrypto  -lgnutls -lgnutls   -lnghttp2  ./dnsdist-rust-lib/rust/libdnsdist_rust.a  -lpthread 
[  369s] libtool: link: g++-11 -std=c++17 -fPIE -DPIE -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 --param ssp-buffer-size=4 -fstack-protector -g -O3 -Wall -Wextra -Wshadow -Wmissing-declarations -Wredundant-decls -fvisibility=hidden -fmessage-length=0 -grecord-gcc-switches -O2 -Wall -D_FORTIFY_SOURCE=2 -fstack-protector-strong -funwind-tables -fasynchronous-unwind-tables -fstack-clash-protection -g -pie -Wl,-z -Wl,relro -Wl,-z -Wl,now -rdynamic -o dnsdist bpf-filter.o capabilities.o channel.o coverage.o credentials.o dns.o dnscrypt.o dnsdist-actions-factory.o dnsdist-actions.o dnsdist-async.o dnsdist-backend.o dnsdist-cache.o dnsdist-carbon.o dnsdist-configuration-yaml.o dnsdist-configuration.o dnsdist-console.o dnsdist-crypto.o dnsdist-discovery.o dnsdist-dnscrypt.o dnsdist-dnsparser.o dnsdist-dnsquestion.o dnsdist-doh-common.o dnsdist-dynblocks.o dnsdist-dynbpf.o dnsdist-ecs.o dnsdist-edns.o dnsdist-frontend.o dnsdist-healthchecks.o dnsdist-idstate.o dnsdist-internal-queries.o dnsdist-kvs.o dnsdist-lbpolicies.o dnsdist-lua-actions.o dnsdist-lua-bindings-dnscrypt.o dnsdist-lua-bindings-dnsparser.o dnsdist-lua-bindings-dnsquestion.o dnsdist-lua-bindings-kvs.o dnsdist-lua-bindings-network.o dnsdist-lua-bindings-packetcache.o dnsdist-lua-bindings-protobuf.o dnsdist-lua-bindings-rings.o dnsdist-lua-bindings.o dnsdist-lua-configuration-items.o dnsdist-lua-ffi.o dnsdist-lua-hooks.o dnsdist-lua-inspection-ffi.o dnsdist-lua-inspection.o dnsdist-lua-network.o dnsdist-lua-rules.o dnsdist-lua-vars.o dnsdist-lua-web.o dnsdist-lua.o dnsdist-mac-address.o dnsdist-metrics.o dnsdist-protobuf.o dnsdist-protocols.o dnsdist-proxy-protocol.o dnsdist-query-count.o dnsdist-random.o dnsdist-resolver.o dnsdist-rings.o dnsdist-rule-chains.o dnsdist-rules.o dnsdist-secpoll.o dnsdist-self-answers.o dnsdist-session-cache.o dnsdist-snmp.o dnsdist-svc.o dnsdist-systemd.o dnsdist-tcp-downstream.o dnsdist-tcp.o dnsdist-web.o dnsdist-xsk.o dnsdist.o dnslabeltext.o dnsname.o dnsparser.o dnstap.o dnswriter.o doh3.o dolog.o ednscookies.o ednsextendederror.o ednsoptions.o ednssubnet.o ext/json11/json11.o fstrm_logger.o gettime.o iputils.o libssl.o misc.o pollmplexer.o protozero.o proxy-protocol.o qtype.o remote_logger.o remote_logger_pool.o snmp-agent.o statnode.o svc-records.o tcpiohandler.o threadname.o uuid-utils.o xsk.o ipcipher.o dnsdist-nghttp2-in.o dnsdist-nghttp2.o dnsdist-rust-lib/dnsdist-configuration-yaml-items-generated.o epollmplexer.o  -lluajit-5.1 -ledit ./ext/yahttp/yahttp/.libs/libyahttp.a -lsodium -lfstrm -lsystemd ./ext/ipcrypt/.libs/libipcrypt.a ./ext/arc4random/.libs/libarc4random.a -lre2 -lssl -lcrypto -lgnutls -lnghttp2 ./dnsdist-rust-lib/rust/libdnsdist_rust.a -lpthread -pthread
[  369s] /usr/lib64/gcc/x86_64-suse-linux/11/../../../../x86_64-suse-linux/bin/ld: ./dnsdist-rust-lib/rust/libdnsdist_rust.a(std-5c3fcc0e31ce8a7a.std.442bdc82062d6ae0-cgu.07.rcgu.o): undefined reference to symbol 'dlsym@@GLIBC_2.2.5'
[  369s] /usr/lib64/gcc/x86_64-suse-linux/11/../../../../x86_64-suse-linux/bin/ld: /lib64/libdl.so.2: error adding symbols: DSO missing from command line
[  369s] collect2: error: ld returned 1 exit status
[  369s] make[2]: *** [Makefile:1745: dnsdist] Error 1
[  369s] make[2]: Leaving directory '/home/abuild/rpmbuild/BUILD/dnsdist-2.0.0-alpha1'
[  369s] make[1]: *** [Makefile:2075: all-recursive] Error 1
[  369s] make[1]: Leaving directory '/home/abuild/rpmbuild/BUILD/dnsdist-2.0.0-alpha1'
[  369s] make: *** [Makefile:1616: all] Error 2

[rgacogne]

Thanks a lot for the feedback, much appreciated! I had this error on EL as well, I had to add -ldl to LDFLAGS to fix it: https://github.com/PowerDNS/pdns/blob/master/builder-support/specs/dnsdist.spec#L77

I'll see if I can detect when that flag is needed it in autotools and meson so you don't have to work-around it.

[paddg]

Ah, I tried
export LDFLAGS+=" -ldl "
as well here, but no luck. Maybe I did it wrong.