Can't run vector on centos 7 arm #18384

dev-lake · 2023-08-25T08:41:17Z

dev-lake
Aug 25, 2023

I got an error when run vector latest version:

[root@ecs-be51-0002 bin]# ./vector
./vector: relocation error: ./vector: symbol __cxa_thread_atexit_impl, version GLIBC_2.18 not defined in file libc.so.6 with link time reference

Env Info:

[root@ecs-be51-0002 bin]# uname -a
Linux ecs-be51-0002 4.18.0-80.7.2.el7.aarch64 #1 SMP Thu Sep 12 16:13:20 UTC 2019 aarch64 aarch64 aarch64 GNU/Linux
[root@ecs-be51-0002 bin]# cat /etc/redhat-release
CentOS Linux release 7.6.1810 (AltArch)
[root@ecs-be51-0002 bin]# cat /etc/os-release
NAME="CentOS Linux"
VERSION="7 (AltArch)"
ID="centos"
ID_LIKE="rhel fedora"
VERSION_ID="7"
PRETTY_NAME="CentOS Linux 7 (AltArch)"
ANSI_COLOR="0;31"
CPE_NAME="cpe:/o:centos:centos:7"
HOME_URL="https://www.centos.org/"
BUG_REPORT_URL="https://bugs.centos.org/"

CENTOS_MANTISBT_PROJECT="CentOS-7"
CENTOS_MANTISBT_PROJECT_VERSION="7"
REDHAT_SUPPORT_PRODUCT="centos"
REDHAT_SUPPORT_PRODUCT_VERSION="7"

GLIBC Info

root@ecs-be51-0002 bin]# strings /usr/lib64/libc.so.6 | grep GLIB
GLIBC_2.17
GLIBC_2.18
GLIBC_PRIVATE
gethostbyname2_r@@GLIBC_2.17
_IO_fopen@@GLIBC_2.17
_IO_file_finish@@GLIBC_2.17
_dl_starting_up@@GLIBC_PRIVATE
_IO_fgetpos@@GLIBC_2.17
getaliasent_r@@GLIBC_2.17
_IO_file_seekoff@@GLIBC_2.17
getrpcent_r@@GLIBC_2.17
getservbyname_r@@GLIBC_2.17
_rtld_global@@GLIBC_PRIVATE
_IO_file_init@@GLIBC_2.17
getservbyport_r@@GLIBC_2.17
__libc_enable_secure@@GLIBC_PRIVATE
posix_spawn@@GLIBC_2.17
tmpfile@@GLIBC_2.17
realpath@@GLIBC_2.17
_IO_fgetpos64@@GLIBC_2.17
getrpcbyname_r@@GLIBC_2.17
_rtld_global_ro@@GLIBC_PRIVATE
__pointer_chk_guard@@GLIBC_PRIVATE
getspent_r@@GLIBC_2.17
_IO_file_close_it@@GLIBC_2.17
sys_sigabbrev@@GLIBC_2.17
_IO_fsetpos@@GLIBC_2.17
_sys_nerr@@GLIBC_2.17
pthread_cond_timedwait@@GLIBC_2.17
_IO_do_write@@GLIBC_2.17
getnetbyname_r@@GLIBC_2.17
getpwnam_r@@GLIBC_2.17
_mcount@@GLIBC_2.18
gethostbyname_r@@GLIBC_2.17
_IO_file_setbuf@@GLIBC_2.17
pthread_cond_destroy@@GLIBC_2.17
getaliasbyname_r@@GLIBC_2.17
getprotoent_r@@GLIBC_2.17
getspnam_r@@GLIBC_2.17
getrpcbynumber_r@@GLIBC_2.17
nftw64@@GLIBC_2.17
getnetent_r@@GLIBC_2.17
_res@GLIBC_2.17
posix_spawnp@@GLIBC_2.17
_IO_popen@@GLIBC_2.17
pclose@@GLIBC_2.17
nftw@@GLIBC_2.17
_IO_file_xsputn@@GLIBC_2.17
_sys_errlist@@GLIBC_2.17
_IO_proc_open@@GLIBC_2.17
_IO_file_overflow@@GLIBC_2.17
_IO_fdopen@@GLIBC_2.17
getgrgid_r@@GLIBC_2.17
getnetbyaddr_r@@GLIBC_2.17
__res_maybe_init@GLIBC_PRIVATE
pthread_cond_signal@@GLIBC_2.17
h_errno@GLIBC_PRIVATE
_IO_file_attach@@GLIBC_2.17
_IO_file_sync@@GLIBC_2.17
getpwuid_r@@GLIBC_2.17
pthread_cond_wait@@GLIBC_2.17
_sys_siglist@@GLIBC_2.17
fopencookie@@GLIBC_2.17
pthread_cond_broadcast@@GLIBC_2.17
getpwent_r@@GLIBC_2.17
gethostbyaddr_r@@GLIBC_2.17
sched_setaffinity@@GLIBC_2.17
getgrent_r@@GLIBC_2.17
fnmatch@@GLIBC_2.17
getgrnam_r@@GLIBC_2.17
_IO_fclose@@GLIBC_2.17
pthread_cond_init@@GLIBC_2.17
regexec@@GLIBC_2.17
localeconv@@GLIBC_2.17
_IO_file_write@@GLIBC_2.17
gethostent_r@@GLIBC_2.17
_IO_proc_close@@GLIBC_2.17
getservent_r@@GLIBC_2.17
_IO_file_fopen@@GLIBC_2.17
getprotobyname_r@@GLIBC_2.17
sched_getaffinity@@GLIBC_2.17
__tls_get_addr@@GLIBC_2.17
getprotobynumber_r@@GLIBC_2.17
_IO_file_underflow@@GLIBC_2.17
_dl_argv@@GLIBC_PRIVATE
pthread_attr_init@@GLIBC_2.17
_IO_fsetpos64@@GLIBC_2.17

I have noticed the issue #13183, but it seems that my problem not due to GLIBC version.

Is there a solution to this problem? Such as recompile Vector or update libc.so.6?

jszwedko · 2023-08-25T15:20:10Z

jszwedko
Aug 25, 2023
Maintainer

Hi @dev-lake !

I think this is due to the lack of #15817 . As a workaround, I think you should be able to recompile Vector on the target system.

6 replies

dev-lake Aug 31, 2023
Author

Due to lack of experence of Rust language, I find it's a very difficult thing for me to rebuild Vector by follow this instruction: https://vector.dev/docs/setup/installation/manual/from-source/ . To Run vector on Centos, I have to solve #15817 and #4392 , after a lot of search and learn, I Found rebuild it is the only solution. So, Can you provide a more detailed instruction or a Compiled compatible version. I will very appreciate that.

dev-lake Aug 31, 2023
Author

I found https://vector.dev/docs/setup/installation/#using-static-musl-builds to solve the glibc problem for that I don't have performance demand. But the pagesize problem stil exists.

jszwedko Sep 1, 2023
Maintainer

Hi @dev-lake !

Does your CentOS 7 distribution also use 64 KiB pages?

I could help you compile a one-off binary, but that doesn't seem like a sustainable pattern :) I believe, on the target system, you should be able to compile Vector with something like:

JEMALLOC_SYS_WITH_LG_PAGE=16 make build-aarch64-unknown-linux-gnu

Can you try that and let me know what you see?

dev-lake Sep 4, 2023
Author

Hi @jszwedko , Thanks a lot for your patience.
As you see, my server is CentOS 7 and also use 64 KiB pages:

[root@ecs-be51-0002 ~]# cat /etc/redhat-release
CentOS Linux release 7.6.1810 (AltArch)
[root@ecs-be51-0002 ~]# cd /proc/1 && sudo grep -i pagesize smaps | sort | uniq
KernelPageSize:       64 kB
MMUPageSize:          64 kB

Because of China's annoying GFW, I can't visit Github directly from the server, so run make build is also a difficult thing. So I have to compile on my M1 Macbook. It works fine when I just use make build:

make build
cargo build --release --no-default-features --features default
   Compiling libc v0.2.147
   ......
   Compiling file-source v0.1.0 (/Users/lake/Projects/vector/lib/file-source)
   Compiling codecs v0.1.0 (/Users/lake/Projects/vector/lib/codecs)
   Compiling rdkafka v0.34.0
    Finished release [optimized] target(s) in 11m 21s

And then I try to compile the Linux version by follow https://github.com/vectordotdev/vector/blob/master/docs/DEVELOPING.md , I enter the docker containter using make environmant and while I use make build, an error accourd while compile vector lib:

root@docker-desktop:/git/vectordotdev/vector# make build
cargo build --release --no-default-features --features default
   Compiling tikv-jemalloc-sys v0.5.2+5.3.0-patched
   Compiling tikv-jemallocator v0.5.4
   Compiling vector v0.33.0 (/git/vectordotdev/vector)
error: could not compile `vector` (lib)

Caused by:
  process didn't exit successfully: `/root/.cargo/bin/wrap-rustc /root/.rustup/toolchains/1.71.1-aarch64-unknown-linux-gnu/bin/rustc --crate-name vector --edition=2021 src/lib.rs --error-format=json --json=diagnostic-rendered-ansi,artifacts,future-incompat --diagnostic-width=159 --crate-type lib --emit=dep-info,metadata,link -C opt-level=3 -C embed-bitcode=no -C debuginfo=0 --cfg 'feature="allocation-tracing"' --cfg 'feature="api"' --cfg 'feature="api-client"' --cfg 'feature="aws-config"' --cfg 'feature="aws-core"' --cfg 'feature="codecs-syslog"' --cfg 'feature="component-validation-runner"' --cfg 'feature="default"' --cfg 'feature="docker"' --cfg 'feature="enrichment-tables"' --cfg 'feature="enrichment-tables-geoip"' --cfg 'feature="enterprise"' --cfg 'feature="gcp"' --cfg 'feature="kubernetes"' --cfg 'feature="lapin"' --cfg 'feature="listenfd"' --cfg 'feature="loki-logproto"' --cfg 'feature="protobuf-build"' --cfg 'feature="sinks"' --cfg 'feature="sinks-amqp"' --cfg 'feature="sinks-appsignal"' --cfg 'feature="sinks-aws_cloudwatch_logs"' --cfg 'feature="sinks-aws_cloudwatch_metrics"' --cfg 'feature="sinks-aws_kinesis_firehose"' --cfg 'feature="sinks-aws_kinesis_streams"' --cfg 'feature="sinks-aws_s3"' --cfg 'feature="sinks-aws_sns"' --cfg 'feature="sinks-aws_sqs"' --cfg 'feature="sinks-axiom"' --cfg 'feature="sinks-azure_blob"' --cfg 'feature="sinks-azure_monitor_logs"' --cfg 'feature="sinks-blackhole"' --cfg 'feature="sinks-chronicle"' --cfg 'feature="sinks-clickhouse"' --cfg 'feature="sinks-console"' --cfg 'feature="sinks-databend"' --cfg 'feature="sinks-datadog_events"' --cfg 'feature="sinks-datadog_logs"' --cfg 'feature="sinks-datadog_metrics"' --cfg 'feature="sinks-datadog_traces"' --cfg 'feature="sinks-elasticsearch"' --cfg 'feature="sinks-file"' --cfg 'feature="sinks-gcp"' --cfg 'feature="sinks-greptimedb"' --cfg 'feature="sinks-honeycomb"' --cfg 'feature="sinks-http"' --cfg 'feature="sinks-humio"' --cfg 'feature="sinks-influxdb"' --cfg 'feature="sinks-kafka"' --cfg 'feature="sinks-logs"' --cfg 'feature="sinks-loki"' --cfg 'feature="sinks-metrics"' --cfg 'feature="sinks-mezmo"' --cfg 'feature="sinks-nats"' --cfg 'feature="sinks-new_relic"' --cfg 'feature="sinks-new_relic_logs"' --cfg 'feature="sinks-papertrail"' --cfg 'feature="sinks-prometheus"' --cfg 'feature="sinks-pulsar"' --cfg 'feature="sinks-redis"' --cfg 'feature="sinks-sematext"' --cfg 'feature="sinks-socket"' --cfg 'feature="sinks-splunk_hec"' --cfg 'feature="sinks-statsd"' --cfg 'feature="sinks-utils-udp"' --cfg 'feature="sinks-vector"' --cfg 'feature="sinks-webhdfs"' --cfg 'feature="sinks-websocket"' --cfg 'feature="sources"' --cfg 'feature="sources-amqp"' --cfg 'feature="sources-apache_metrics"' --cfg 'feature="sources-aws_ecs_metrics"' --cfg 'feature="sources-aws_kinesis_firehose"' --cfg 'feature="sources-aws_s3"' --cfg 'feature="sources-aws_sqs"' --cfg 'feature="sources-datadog_agent"' --cfg 'feature="sources-demo_logs"' --cfg 'feature="sources-dnstap"' --cfg 'feature="sources-docker_logs"' --cfg 'feature="sources-eventstoredb_metrics"' --cfg 'feature="sources-exec"' --cfg 'feature="sources-file"' --cfg 'feature="sources-file-descriptor"' --cfg 'feature="sources-fluent"' --cfg 'feature="sources-gcp_pubsub"' --cfg 'feature="sources-heroku_logs"' --cfg 'feature="sources-host_metrics"' --cfg 'feature="sources-http_client"' --cfg 'feature="sources-http_server"' --cfg 'feature="sources-internal_logs"' --cfg 'feature="sources-internal_metrics"' --cfg 'feature="sources-journald"' --cfg 'feature="sources-kafka"' --cfg 'feature="sources-kubernetes_logs"' --cfg 'feature="sources-logs"' --cfg 'feature="sources-logstash"' --cfg 'feature="sources-metrics"' --cfg 'feature="sources-mongodb_metrics"' --cfg 'feature="sources-nats"' --cfg 'feature="sources-nginx_metrics"' --cfg 'feature="sources-opentelemetry"' --cfg 'feature="sources-postgresql_metrics"' --cfg 'feature="sources-prometheus"' --cfg 'feature="sources-prometheus-remote-write"' --cfg 'feature="sources-prometheus-scrape"' --cfg 'feature="sources-redis"' --cfg 'feature="sources-socket"' --cfg 'feature="sources-splunk_hec"' --cfg 'feature="sources-statsd"' --cfg 'feature="sources-stdin"' --cfg 'feature="sources-syslog"' --cfg 'feature="sources-utils-http"' --cfg 'feature="sources-utils-http-auth"' --cfg 'feature="sources-utils-http-client"' --cfg 'feature="sources-utils-http-encoding"' --cfg 'feature="sources-utils-http-error"' --cfg 'feature="sources-utils-http-prelude"' --cfg 'feature="sources-utils-http-query"' --cfg 'feature="sources-utils-net"' --cfg 'feature="sources-utils-net-tcp"' --cfg 'feature="sources-utils-net-udp"' --cfg 'feature="sources-utils-net-unix"' --cfg 'feature="sources-vector"' --cfg 'feature="tikv-jemallocator"' --cfg 'feature="transforms"' --cfg 'feature="transforms-aggregate"' --cfg 'feature="transforms-aws_ec2_metadata"' --cfg 'feature="transforms-dedupe"' --cfg 'feature="transforms-filter"' --cfg 'feature="transforms-log_to_metric"' --cfg 'feature="transforms-logs"' --cfg 'feature="transforms-lua"' --cfg 'feature="transforms-metric_to_log"' --cfg 'feature="transforms-metrics"' --cfg 'feature="transforms-pipelines"' --cfg 'feature="transforms-reduce"' --cfg 'feature="transforms-remap"' --cfg 'feature="transforms-route"' --cfg 'feature="transforms-sample"' --cfg 'feature="transforms-tag_cardinality_limit"' --cfg 'feature="transforms-throttle"' --cfg 'feature="unix"' -C metadata=025b1772172d2306 -C extra-filename=-025b1772172d2306 --out-dir /git/vectordotdev/vector/target/release/deps -L dependency=/git/vectordotdev/vector/target/release/deps --extern apache_avro=/git/vectordotdev/vector/target/release/deps/libapache_avro-04af2572bc2c14ba.rmeta --extern arc_swap=/git/vectordotdev/vector/target/release/deps/libarc_swap-c68a702f02785f83.rmeta --extern arr_macro=/git/vectordotdev/vector/target/release/deps/libarr_macro-35f74afdf88eae3e.rmeta --extern async_compression=/git/vectordotdev/vector/target/release/deps/libasync_compression-9e1c81437cea7acd.rmeta --extern async_graphql=/git/vectordotdev/vector/target/release/deps/libasync_graphql-5b66bcfebfb348a7.rmeta --extern async_graphql_warp=/git/vectordotdev/vector/target/release/deps/libasync_graphql_warp-66ce8c7726c1fbda.rmeta --extern async_nats=/git/vectordotdev/vector/target/release/deps/libasync_nats-077439b587d56c5f.rmeta --extern async_stream=/git/vectordotdev/vector/target/release/deps/libasync_stream-3c6de45240dac90c.rmeta --extern async_trait=/git/vectordotdev/vector/target/release/deps/libasync_trait-d2135a4f11896c73.so --extern atty=/git/vectordotdev/vector/target/release/deps/libatty-ec81eb63a3a203ca.rmeta --extern aws_config=/git/vectordotdev/vector/target/release/deps/libaws_config-5997679234d3f498.rmeta --extern aws_credential_types=/git/vectordotdev/vector/target/release/deps/libaws_credential_types-daa605dda88fbc7a.rmeta --extern aws_sdk_cloudwatch=/git/vectordotdev/vector/target/release/deps/libaws_sdk_cloudwatch-43a0928e1d84847d.rmeta --extern aws_sdk_cloudwatchlogs=/git/vectordotdev/vector/target/release/deps/libaws_sdk_cloudwatchlogs-dce22fc5ba6f7cb3.rmeta --extern aws_sdk_firehose=/git/vectordotdev/vector/target/release/deps/libaws_sdk_firehose-d7663f231cb7de61.rmeta --extern aws_sdk_kinesis=/git/vectordotdev/vector/target/release/deps/libaws_sdk_kinesis-59e3e1b935fc685c.rmeta --extern aws_sdk_s3=/git/vectordotdev/vector/target/release/deps/libaws_sdk_s3-303a828dee2ccf83.rmeta --extern aws_sdk_sns=/git/vectordotdev/vector/target/release/deps/libaws_sdk_sns-e08b8ffab27fc85d.rmeta --extern aws_sdk_sqs=/git/vectordotdev/vector/target/release/deps/libaws_sdk_sqs-abf1d2d306f1fe09.rmeta --extern aws_sigv4=/git/vectordotdev/vector/target/release/deps/libaws_sigv4-c70cd6a78b0032f3.rmeta --extern aws_smithy_async=/git/vectordotdev/vector/target/release/deps/libaws_smithy_async-951c9e4aca48dcba.rmeta --extern aws_smithy_client=/git/vectordotdev/vector/target/release/deps/libaws_smithy_client-a73f1c0e6fdb2d12.rmeta --extern aws_smithy_http=/git/vectordotdev/vector/target/release/deps/libaws_smithy_http-67215cdf4d3e6a4e.rmeta --extern aws_smithy_http_tower=/git/vectordotdev/vector/target/release/deps/libaws_smithy_http_tower-9b8ad37f22a90dff.rmeta --extern aws_smithy_types=/git/vectordotdev/vector/target/release/deps/libaws_smithy_types-5cbb20a7bb6c92f1.rmeta --extern aws_types=/git/vectordotdev/vector/target/release/deps/libaws_types-245016775392b969.rmeta --extern axum=/git/vectordotdev/vector/target/release/deps/libaxum-5788bf9b7f1291ee.rmeta --extern azure_core=/git/vectordotdev/vector/target/release/deps/libazure_core-169db02780385c0d.rmeta --extern azure_identity=/git/vectordotdev/vector/target/release/deps/libazure_identity-47cdd2c388267a8d.rmeta --extern azure_storage=/git/vectordotdev/vector/target/release/deps/libazure_storage-8f976a9f91e36189.rmeta --extern azure_storage_blobs=/git/vectordotdev/vector/target/release/deps/libazure_storage_blobs-4b91203e953d6332.rmeta --extern base64=/git/vectordotdev/vector/target/release/deps/libbase64-e420a805f76b4870.rmeta --extern bloomy=/git/vectordotdev/vector/target/release/deps/libbloomy-719a7209fecd6e19.rmeta --extern bollard=/git/vectordotdev/vector/target/release/deps/libbollard-a9a11166512e1e15.rmeta --extern bytes=/git/vectordotdev/vector/target/release/deps/libbytes-d1e49daa6d2499e3.rmeta --extern bytesize=/git/vectordotdev/vector/target/release/deps/libbytesize-c188580c970eaff4.rmeta --extern chrono=/git/vectordotdev/vector/target/release/deps/libchrono-c9728b1194baefb4.rmeta --extern cidr_utils=/git/vectordotdev/vector/target/release/deps/libcidr_utils-917fbac043ca2a84.rmeta --extern clap=/git/vectordotdev/vector/target/release/deps/libclap-c480708f1c3435ce.rmeta --extern codecs=/git/vectordotdev/vector/target/release/deps/libcodecs-b0bfe0cd7937759b.rmeta --extern colored=/git/vectordotdev/vector/target/release/deps/libcolored-19584ea4298926e9.rmeta --extern crossterm=/git/vectordotdev/vector/target/release/deps/libcrossterm-843e10126a2d95f2.rmeta --extern csv=/git/vectordotdev/vector/target/release/deps/libcsv-da10a90350d79ef0.rmeta --extern derivative=/git/vectordotdev/vector/target/release/deps/libderivative-1fcf9effe8180947.so --extern dirs_next=/git/vectordotdev/vector/target/release/deps/libdirs_next-80f518a37aba2fa0.rmeta --extern dnsmsg_parser=/git/vectordotdev/vector/target/release/deps/libdnsmsg_parser-3154a037059242a3.rmeta --extern dyn_clone=/git/vectordotdev/vector/target/release/deps/libdyn_clone-3b6877fd2124c293.rmeta --extern encoding_rs=/git/vectordotdev/vector/target/release/deps/libencoding_rs-b94ec05c5743abb5.rmeta --extern enrichment=/git/vectordotdev/vector/target/release/deps/libenrichment-b96995c58064e68f.rmeta --extern enum_dispatch=/git/vectordotdev/vector/target/release/deps/libenum_dispatch-efd138b8cf055223.so --extern exitcode=/git/vectordotdev/vector/target/release/deps/libexitcode-014ec3d08e8cfe4c.rmeta --extern fakedata=/git/vectordotdev/vector/target/release/deps/libfakedata-9d9d9b8e046926bb.rmeta --extern file_source=/git/vectordotdev/vector/target/release/deps/libfile_source-927e5b337b0c5f69.rmeta --extern flate2=/git/vectordotdev/vector/target/release/deps/libflate2-9ab373002b8bf06c.rmeta --extern futures=/git/vectordotdev/vector/target/release/deps/libfutures-5d8afa1d6668f28d.rmeta --extern futures_util=/git/vectordotdev/vector/target/release/deps/libfutures_util-07fac3e5b0317171.rmeta --extern glob=/git/vectordotdev/vector/target/release/deps/libglob-fe8dc62a8dc780fc.rmeta --extern goauth=/git/vectordotdev/vector/target/release/deps/libgoauth-6ea31a9964524793.rmeta --extern governor=/git/vectordotdev/vector/target/release/deps/libgovernor-6f7d99ee739da1a5.rmeta --extern greptimedb_client=/git/vectordotdev/vector/target/release/deps/libgreptimedb_client-0cc88b0d89449163.rmeta --extern h2=/git/vectordotdev/vector/target/release/deps/libh2-df3b4513f7d70b7d.rmeta --extern hash_hasher=/git/vectordotdev/vector/target/release/deps/libhash_hasher-a796ae6a35786c69.rmeta --extern hashbrown=/git/vectordotdev/vector/target/release/deps/libhashbrown-619c4ee533c8bd50.rmeta --extern headers=/git/vectordotdev/vector/target/release/deps/libheaders-85337d2ed8414b70.rmeta --extern heim=/git/vectordotdev/vector/target/release/deps/libheim-834c70b9d627807c.rmeta --extern hex=/git/vectordotdev/vector/target/release/deps/libhex-ce0896833765d387.rmeta --extern hostname=/git/vectordotdev/vector/target/release/deps/libhostname-1bd9c0ad673a335f.rmeta --extern http=/git/vectordotdev/vector/target/release/deps/libhttp-f6bb22a98e0d849b.rmeta --extern http_body=/git/vectordotdev/vector/target/release/deps/libhttp_body-f76838a4b9f6ae29.rmeta --extern http_serde=/git/vectordotdev/vector/target/release/deps/libhttp_serde-1a5fce967d5b4036.rmeta --extern hyper=/git/vectordotdev/vector/target/release/deps/libhyper-b912b01adf93f69d.rmeta --extern hyper_openssl=/git/vectordotdev/vector/target/release/deps/libhyper_openssl-a87b52ea10615d38.rmeta --extern hyper_proxy=/git/vectordotdev/vector/target/release/deps/libhyper_proxy-2464ee0057248013.rmeta --extern indexmap=/git/vectordotdev/vector/target/release/deps/libindexmap-74efd70a87f9a41b.rmeta --extern indoc=/git/vectordotdev/vector/target/release/deps/libindoc-3f42359122f2208a.so --extern infer=/git/vectordotdev/vector/target/release/deps/libinfer-21208d20685f0a5a.rmeta --extern inventory=/git/vectordotdev/vector/target/release/deps/libinventory-ebed56a63409452f.rmeta --extern itertools=/git/vectordotdev/vector/target/release/deps/libitertools-fbcec33bd484d9a0.rmeta --extern k8s_openapi=/git/vectordotdev/vector/target/release/deps/libk8s_openapi-44bf4c36847a72d1.rmeta --extern kube=/git/vectordotdev/vector/target/release/deps/libkube-879f1142ad954f0e.rmeta --extern lapin=/git/vectordotdev/vector/target/release/deps/liblapin-9ab8def29480c591.rmeta --extern listenfd=/git/vectordotdev/vector/target/release/deps/liblistenfd-c79592807dff69b6.rmeta --extern loki_logproto=/git/vectordotdev/vector/target/release/deps/libloki_logproto-69a7250e25aed52b.rmeta --extern lru=/git/vectordotdev/vector/target/release/deps/liblru-7f20a7c7ca3ddcca.rmeta --extern maxminddb=/git/vectordotdev/vector/target/release/deps/libmaxminddb-5cab6a42451ac26e.rmeta --extern md5=/git/vectordotdev/vector/target/release/deps/libmd5-a85f1b65d83ef4c5.rmeta --extern metrics=/git/vectordotdev/vector/target/release/deps/libmetrics-5b655993cacbd992.rmeta --extern metrics_tracing_context=/git/vectordotdev/vector/target/release/deps/libmetrics_tracing_context-e0c240a5e71a2707.rmeta --extern mlua=/git/vectordotdev/vector/target/release/deps/libmlua-2704da4d81ec5362.rmeta --extern mongodb=/git/vectordotdev/vector/target/release/deps/libmongodb-3c3e3a3df125cb03.rmeta --extern nix=/git/vectordotdev/vector/target/release/deps/libnix-ddbd768e535e7bc9.rmeta --extern nkeys=/git/vectordotdev/vector/target/release/deps/libnkeys-c8d9745c24834bf8.rmeta --extern nom=/git/vectordotdev/vector/target/release/deps/libnom-fa2a0fd689ffa743.rmeta --extern notify=/git/vectordotdev/vector/target/release/deps/libnotify-f8c686513368ba0f.rmeta --extern num_format=/git/vectordotdev/vector/target/release/deps/libnum_format-269f9497fc626241.rmeta --extern number_prefix=/git/vectordotdev/vector/target/release/deps/libnumber_prefix-ce4db1d2fa6c1277.rmeta --extern once_cell=/git/vectordotdev/vector/target/release/deps/libonce_cell-4c1159156a115172.rmeta --extern opendal=/git/vectordotdev/vector/target/release/deps/libopendal-c923008e02cf8e52.rmeta --extern openssl=/git/vectordotdev/vector/target/release/deps/libopenssl-f84d23e3c2a34d2b.rmeta --extern openssl_probe=/git/vectordotdev/vector/target/release/deps/libopenssl_probe-48bcea1881ef7e15.rmeta --extern opentelemetry_proto=/git/vectordotdev/vector/target/release/deps/libopentelemetry_proto-7922044d0afcdb94.rmeta --extern ordered_float=/git/vectordotdev/vector/target/release/deps/libordered_float-460e65e3713aa438.rmeta --extern paste=/git/vectordotdev/vector/target/release/deps/libpaste-5f88900970f9ad50.so --extern percent_encoding=/git/vectordotdev/vector/target/release/deps/libpercent_encoding-83c68d6f82ded1e5.rmeta --extern pin_project=/git/vectordotdev/vector/target/release/deps/libpin_project-309af3c2d0899913.rmeta --extern portpicker=/git/vectordotdev/vector/target/release/deps/libportpicker-1a7bde5c1b0b6db4.rmeta --extern postgres_openssl=/git/vectordotdev/vector/target/release/deps/libpostgres_openssl-a33b1041a9615b4e.rmeta --extern prometheus_parser=/git/vectordotdev/vector/target/release/deps/libprometheus_parser-0c78c0504476bfbe.rmeta --extern prost=/git/vectordotdev/vector/target/release/deps/libprost-4fe62e15639b8413.rmeta --extern prost_reflect=/git/vectordotdev/vector/target/release/deps/libprost_reflect-a13ce16cda472a6c.rmeta --extern prost_types=/git/vectordotdev/vector/target/release/deps/libprost_types-b29385808c1b0783.rmeta --extern pulsar=/git/vectordotdev/vector/target/release/deps/libpulsar-a84364dab09a84dd.rmeta --extern rand=/git/vectordotdev/vector/target/release/deps/librand-cb53c4a98bd5b325.rmeta --extern rand_distr=/git/vectordotdev/vector/target/release/deps/librand_distr-3472d76a202be4d1.rmeta --extern ratatui=/git/vectordotdev/vector/target/release/deps/libratatui-25b9005051c45a9c.rmeta --extern rdkafka=/git/vectordotdev/vector/target/release/deps/librdkafka-7aa757120e7d2876.rmeta --extern redis=/git/vectordotdev/vector/target/release/deps/libredis-65163dcf77154334.rmeta --extern regex=/git/vectordotdev/vector/target/release/deps/libregex-8821af521d67c5d7.rmeta --extern rmp_serde=/git/vectordotdev/vector/target/release/deps/librmp_serde-e54140f779e82471.rmeta --extern rmpv=/git/vectordotdev/vector/target/release/deps/librmpv-cffe751f06f2270f.rmeta --extern roaring=/git/vectordotdev/vector/target/release/deps/libroaring-3b7d4d35f72aa4b5.rmeta --extern seahash=/git/vectordotdev/vector/target/release/deps/libseahash-bdf3fa3216dac654.rmeta --extern semver=/git/vectordotdev/vector/target/release/deps/libsemver-58fe56858a067626.rmeta --extern serde=/git/vectordotdev/vector/target/release/deps/libserde-3b8aa9b48922c232.rmeta --extern serde_toml_merge=/git/vectordotdev/vector/target/release/deps/libserde_toml_merge-f00f15a37d799442.rmeta --extern serde_bytes=/git/vectordotdev/vector/target/release/deps/libserde_bytes-34fdd8fe7d99f8af.rmeta --extern serde_json=/git/vectordotdev/vector/target/release/deps/libserde_json-922dbfe7cf002c13.rmeta --extern serde_with=/git/vectordotdev/vector/target/release/deps/libserde_with-79f1c0111a6b8eab.rmeta --extern serde_yaml=/git/vectordotdev/vector/target/release/deps/libserde_yaml-8c5c77e450e48743.rmeta --extern sha2=/git/vectordotdev/vector/target/release/deps/libsha2-e8a78df8b3f38fc4.rmeta --extern smallvec=/git/vectordotdev/vector/target/release/deps/libsmallvec-27a8ac91ea0e0dff.rmeta --extern smpl_jwt=/git/vectordotdev/vector/target/release/deps/libsmpl_jwt-057d96a52db4d288.rmeta --extern snafu=/git/vectordotdev/vector/target/release/deps/libsnafu-f84c4e1b32a669ec.rmeta --extern snap=/git/vectordotdev/vector/target/release/deps/libsnap-54b072f7f43f4029.rmeta --extern socket2=/git/vectordotdev/vector/target/release/deps/libsocket2-0796a7a5fe51d78b.rmeta --extern stream_cancel=/git/vectordotdev/vector/target/release/deps/libstream_cancel-4679904fff60c5ad.rmeta --extern strip_ansi_escapes=/git/vectordotdev/vector/target/release/deps/libstrip_ansi_escapes-ad8acd1a057937a0.rmeta --extern syslog=/git/vectordotdev/vector/target/release/deps/libsyslog-d06c72fae9ea73c6.rmeta --extern tikv_jemallocator=/git/vectordotdev/vector/target/release/deps/libtikv_jemallocator-91faa81e92943726.rmeta --extern tokio=/git/vectordotdev/vector/target/release/deps/libtokio-6e26520682c99a8b.rmeta --extern tokio_openssl=/git/vectordotdev/vector/target/release/deps/libtokio_openssl-46c6572e8a3f44af.rmeta --extern tokio_postgres=/git/vectordotdev/vector/target/release/deps/libtokio_postgres-af8300f7085e7f5f.rmeta --extern tokio_stream=/git/vectordotdev/vector/target/release/deps/libtokio_stream-af053d94803f1fde.rmeta --extern tokio_tungstenite=/git/vectordotdev/vector/target/release/deps/libtokio_tungstenite-7a628390c6d38176.rmeta --extern tokio_util=/git/vectordotdev/vector/target/release/deps/libtokio_util-e573e499c68793be.rmeta --extern toml=/git/vectordotdev/vector/target/release/deps/libtoml-86e4ac1c7d3e7921.rmeta --extern tonic=/git/vectordotdev/vector/target/release/deps/libtonic-1029d86d4518ae59.rmeta --extern tower=/git/vectordotdev/vector/target/release/deps/libtower-27df74366396ad57.rmeta --extern tower_http=/git/vectordotdev/vector/target/release/deps/libtower_http-504e004773da2fcd.rmeta --extern tracing=/git/vectordotdev/vector/target/release/deps/libtracing-543ba1a130c56310.rmeta --extern tracing_core=/git/vectordotdev/vector/target/release/deps/libtracing_core-f1422ac448cb35a3.rmeta --extern tracing_futures=/git/vectordotdev/vector/target/release/deps/libtracing_futures-9c84567b0428688a.rmeta --extern tracing_limit=/git/vectordotdev/vector/target/release/deps/libtracing_limit-ef659849637a89fc.rmeta --extern tracing_subscriber=/git/vectordotdev/vector/target/release/deps/libtracing_subscriber-25f458bfc54c39d0.rmeta --extern tracing_tower=/git/vectordotdev/vector/target/release/deps/libtracing_tower-b3c1bc96a3cb8bb4.rmeta --extern trust_dns_proto=/git/vectordotdev/vector/target/release/deps/libtrust_dns_proto-3edc1c7d6d2c6726.rmeta --extern typetag=/git/vectordotdev/vector/target/release/deps/libtypetag-1d3cc8671c333b0d.rmeta --extern url=/git/vectordotdev/vector/target/release/deps/liburl-88aec81d3c9509f2.rmeta --extern uuid=/git/vectordotdev/vector/target/release/deps/libuuid-7a29da48cccee030.rmeta --extern vector_api_client=/git/vectordotdev/vector/target/release/deps/libvector_api_client-f5ae099577078f47.rmeta --extern vector_buffers=/git/vectordotdev/vector/target/release/deps/libvector_buffers-b2b93eabbea74720.rmeta --extern vector_common=/git/vectordotdev/vector/target/release/deps/libvector_common-8af630d1cc91c1d5.rmeta --extern vector_config=/git/vectordotdev/vector/target/release/deps/libvector_config-cbe506987e150b83.rmeta --extern vector_config_common=/git/vectordotdev/vector/target/release/deps/libvector_config_common-a5157ed848900ec1.rmeta --extern vector_config_macros=/git/vectordotdev/vector/target/release/deps/libvector_config_macros-bb27da1cf7e16f97.so --extern vector_core=/git/vectordotdev/vector/target/release/deps/libvector_core-420821d8124bcf8d.rmeta --extern lookup=/git/vectordotdev/vector/target/release/deps/libvector_lookup-634415eab6cdd78f.rmeta --extern vector_vrl_functions=/git/vectordotdev/vector/target/release/deps/libvector_vrl_functions-6857349f65885692.rmeta --extern vrl=/git/vectordotdev/vector/target/release/deps/libvrl-c54ee11cea0148bf.rmeta --extern warp=/git/vectordotdev/vector/target/release/deps/libwarp-13cc854d1fd1e5df.rmeta --extern zstd=/git/vectordotdev/vector/target/release/deps/libzstd-64855d49ab41861c.rmeta -C link-args=-rdynamic '-Dclippy::print_stdout' '-Dclippy::print_stderr' '-Dclippy::dbg_macro' -L native=/git/vectordotdev/vector/target/release/build/zstd-sys-5a15f7a9940cc31e/out -L native=/git/vectordotdev/vector/target/release/build/ring-83ead5d913c4ccef/out -L native=/git/vectordotdev/vector/target/release/build/openssl-sys-e1f84763baa00359/out/openssl-build/install/lib -L native=/git/vectordotdev/vector/target/release/build/onig_sys-0fe07703c711ab42/out -L native=/git/vectordotdev/vector/target/release/build/mlua-6838a508b98f5f89/out/lua-build/lib -L native=/git/vectordotdev/vector/target/release/build/lz4-sys-e6c56a13dd1b4d6e/out -L native=/git/vectordotdev/vector/target/release/build/rdkafka-sys-58df517428d5befd/out/src -L native=/git/vectordotdev/vector/target/release/build/libz-sys-8a05669f0eb5fb3a/out/lib -L native=/git/vectordotdev/vector/target/release/build/libz-sys-8a05669f0eb5fb3a/out/lib -L native=/git/vectordotdev/vector/target/release/build/sasl2-sys-a11d0e56a6cf57f2/out/install/lib -L native=/git/vectordotdev/vector/target/release/build/krb5-src-8c7795ebe2609e3f/out/install/lib -L native=/git/vectordotdev/vector/target/release/build/tikv-jemalloc-sys-82717c7263d667f2/out/build/lib` (signal: 9, SIGKILL: kill)
make: *** [Makefile:186: build] Error 101

At same time, make build-dev works fine:

root@docker-desktop:/git/vectordotdev/vector# make build-dev
cargo build --no-default-features --features default
   Compiling tikv-jemalloc-sys v0.5.2+5.3.0-patched
   Compiling tikv-jemallocator v0.5.4
   Compiling vector v0.33.0 (/git/vectordotdev/vector)
    Finished dev [unoptimized + debuginfo] target(s) in 1m 42s

This is the first thing confusing me.

Accouding to your latest suggestion, I come back to Mac's shell, and run JEMALLOC_SYS_WITH_LG_PAGE=16 make build-aarch64-unknown-linux-gnu, an error accourd:

JEMALLOC_SYS_WITH_LG_PAGE=16 make build-aarch64-unknown-linux-gnu
/Applications/Xcode.app/Contents/Developer/usr/bin/make -k cross-image-aarch64-unknown-linux-gnu
docker build \
		--tag vector-cross-env:aarch64-unknown-linux-gnu \
		--file scripts/cross/aarch64-unknown-linux-gnu.dockerfile \
		.
[+] Building 3.5s (3/3) FINISHED
 => [internal] load build definition from aarch64-unknown-linux-gnu.dockerfile                                                                            0.0s
 => => transferring dockerfile: 293B                                                                                                                      0.0s
 => [internal] load .dockerignore                                                                                                                         0.0s
 => => transferring context: 71B                                                                                                                          0.0s
 => ERROR [internal] load metadata for ghcr.io/cross-rs/aarch64-unknown-linux-gnu:0.2.5                                                                   3.4s
------
 > [internal] load metadata for ghcr.io/cross-rs/aarch64-unknown-linux-gnu:0.2.5:
------
failed to solve with frontend dockerfile.v0: failed to create LLB definition: no match for platform in manifest sha256:7f8308a8734d9fcd2ebbe9a3e4bdea74af293f0799d80c3cc341e340cda49a4c: not found
make[1]: *** [cross-image-aarch64-unknown-linux-gnu] Error 1
make: *** [target/aarch64-unknown-linux-gnu/release/vector] Error 2

It seems that this error happend while pull an image, so I try:

docker pull ghcr.io/cross-rs/aarch64-unknown-linux-gnu:0.2.5
0.2.5: Pulling from cross-rs/aarch64-unknown-linux-gnu
no matching manifest for linux/arm64/v8 in the manifest list entries

This is the Second problem.

Thank you again for your time and patience!

jszwedko Sep 5, 2023
Maintainer

Thanks for trying that @dev-lake !

Can you try installing cross from master? `cross-rs/cross#1214 (comment) leads me to believe you need some unreleased changes to do the cross-compiling on M1s. Warning: cross-compiling on on the M1 Mac is probably going to be sloooow since it'll all happen in the Docker virtual machine. If you have access to a Linux system, that might be easier.

Separately, I don't think that'll end up with a working binary since it'll still be using a newer libc than your target system has. I still think compiling on the target system might be the best route for you.

We are also looking into bumping the page size for Vector generally in #18481. If we follow through with that, that should at least fix one of your problems.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Can't run vector on centos 7 arm #18384

Uh oh!

{{title}}

Uh oh!

Replies: 1 comment 6 replies

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Can't run vector on centos 7 arm #18384

Uh oh!

dev-lake Aug 25, 2023

Replies: 1 comment · 6 replies

Uh oh!

jszwedko Aug 25, 2023 Maintainer

Uh oh!

dev-lake Aug 31, 2023 Author

Uh oh!

dev-lake Aug 31, 2023 Author

Uh oh!

jszwedko Sep 1, 2023 Maintainer

Uh oh!

dev-lake Sep 4, 2023 Author

Uh oh!

jszwedko Sep 5, 2023 Maintainer

dev-lake
Aug 25, 2023

Replies: 1 comment 6 replies

jszwedko
Aug 25, 2023
Maintainer

dev-lake Aug 31, 2023
Author

dev-lake Aug 31, 2023
Author

jszwedko Sep 1, 2023
Maintainer

dev-lake Sep 4, 2023
Author

jszwedko Sep 5, 2023
Maintainer