Jaeger - Distributed Tracing Platform
Opensearch and Spark Decencies fail to connect and run. #8056
Replies: 1 comment 1 reply
-
|
Test disabling SSL first
Then you can try something like this to mount the certificate.
|
Beta Was this translation helpful? Give feedback.
-
|
I tried the suggestion of disabling SSL first. I am not sure where the additional environmental values are coming from. But that did not change things. I am trying to run this from the same computer that is running my OpenSearch instance. I can use DataPrepper to get my metrics, logs, and traces. And the dashboard is working, so I know the OpenSearch instance is running. When I connect using CURL, I get the following. curl -X GET https://172.16.18.242:9200 --insecure -u 'admin:Password'
{
"name" : "prometheus",
"cluster_name" : "observability",
"cluster_uuid" : "gtCKotUUTsCvI_m1LQ6EGg",
"version" : {
"distribution" : "opensearch",
"number" : "3.5.0",
"build_type" : "deb",
"build_hash" : "bbc94f0bdc3a759011e6529ecfe52840856f91a3",
"build_date" : "2026-02-07T08:00:43.283485906Z",
"build_snapshot" : false,
"lucene_version" : "10.3.2",
"minimum_wire_compatibility_version" : "2.19.0",
"minimum_index_compatibility_version" : "2.0.0"
},
"tagline" : "The OpenSearch Project: https://opensearch.org/"
}I did not move on to the next step since the first suggestion was not working. I know that Docker containers can talk to the server since Data Prepper is talking to the server to send in its data. docker run --name data-prepper -d \
-p 4900:4900 \
-p 21893:21893 \
-p 21892:21892 \
-p 21891:21891 \
-p 21890:21890 \
-v /usr/share/data-prepper/pipelines.yaml:/usr/share/data-prepper/pipelines/pipelines.yaml \
-v /usr/share/data-prepper/ssl/fullchain.pem:/usr/share/data-prepper/pipelines/server.crt \
-v /usr/share/data-prepper/ssl/privkey.pem:/usr/share/data-prepper/pipelines/server.key \
opensearchproject/data-prepper:latestusing this configuration to sink to OpenSearch. sink:
- opensearch:
hosts:
- "https://prometheus.wizardsunlimited.com:9200"
username: "admin"
password: ""
insecure: false
cert: /usr/share/data-prepper/server.crt
index_type: custom
index: ss4o_metrics-otel-%{yyyy.MM.dd}
bulk_size: 4
template_type: index-template
- stdout:
format: json |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
I am trying to use OpenSearch with Spark. OpenSearch is running under https. In most other cases, I have had to include the certificate chain or set the connection as insecure to make the connection work. The Spark project is also reporting that it is unable to determine the version of OpenSearch I am running and does not seem to be able to make a connection.
This is what I am using to attempt the connection.
docker run \ --env STORAGE=opensearch \ --env OS_NODES_WAN_ONLY=True \ --env OS_USERNAME=admin \ --env OS_PASSWORD="" \ --env OS_NODES=https://172.16.18.242:9200 \ --env LOG4J_STATUS_LOGGER_LEVEL=DEBUG \ ghcr.io/jaegertracing/spark-dependencies/spark-dependencies:v0.7.2-opensearchWhen run, I get the following errors back.
Beta Was this translation helpful? Give feedback.
All reactions