Under what scenarios might the Tomcat 7 instrumentation and the Tomcat 10 instrumentation take effect simultaneously?

[huange7]

Hi, i think there are something wrong with my application, the tomcat7 instrumentation and tomcat10 instrumentation may work at the same time.

my application:
springboot 3.2.5
spring-boot-starter-actuator 3.2.5
java 22
javaagent: 2.3

here are the logs:

[otel.javaagent 2024-08-22 17:18:56:178 +0800] [http-nio-80-exec-1] INFO io.opentelemetry.javaagent.shaded.instrumentation.api.instrumenter.SpanSuppressor - parentContext:{tencent-trace-is-store=true, opentelemetry-http-server-route-key=io.opentelemetry.javaagent.shaded.instrumentation.api.internal.HttpRouteState@20c9b6c5, opentelemetry-servlet-app-server-bridge=io.opentelemetry.javaagent.bootstrap.servlet.AppServerBridge@595cee27, opentelemetry-trace-span-key=SdkSpan{traceId=56dbbb51be9011d27702a74c2856d726, spanId=8b61fd0e6505a465, parentSpanContext=ImmutableSpanContext{traceId=00000000000000000000000000000000, spanId=0000000000000000, traceFlags=00, traceState=ArrayBasedTraceState{entries=[]}, remote=false, valid=false}, name=GET, kind=SERVER, attributes=AttributesMap{data={server.port=80, server.address=xxx, client.address=xxx, origin.component=io.opentelemetry.tomcat-7.0, url.path=/actuator/info, component=tomcat, span.kind=SERVER, http.request.method=GET, thread.id=69, operation=GET, user_agent.original=xxx, url.scheme=http, thread.name=http-nio-80-exec-1}, capacity=128, totalAddedValues=13}, status=ImmutableStatusData{statusCode=UNSET, description=}, totalRecordedEvents=0, totalRecordedLinks=0, startEpochNanos=1724318336174660933, endEpochNanos=0}, http-server-metrics-state=State{startAttributes={server.port=80, server.address=xxx, client.address=xxx, user_agent.original=xxx, origin.component=io.opentelemetry.tomcat-7.0, url.path=/actuator/info, component=tomcat, span.kind=SERVER, http.request.method=GET, operation=GET, url.scheme=http}, startTimeNanos=22312898600433320}, http-server-request-metrics-state=State{startAttributes={server.port=80, server.address=xxx, client.address=xxx, user_agent.original=xxx, origin.component=io.opentelemetry.tomcat-7.0, url.path=/actuator/info, component=tomcat, span.kind=SERVER, http.request.method=GET, operation=GET, url.scheme=http}, startTimeNanos=22312898600433320}, opentelemetry-traces-local-root-span=SdkSpan{traceId=56dbbb51be9011d27702a74c2856d726, spanId=8b61fd0e6505a465, parentSpanContext=ImmutableSpanContext{traceId=00000000000000000000000000000000, spanId=0000000000000000, traceFlags=00, traceState=ArrayBasedTraceState{entries=[]}, remote=false, valid=false}, name=GET, kind=SERVER, attributes=AttributesMap{data={server.port=80, server.address=xxx, client.address=xxx, origin.component=io.opentelemetry.tomcat-7.0, url.path=/actuator/info, component=tomcat, span.kind=SERVER, http.request.method=GET, thread.id=69, operation=GET, user_agent.original=xxx, url.scheme=http, thread.name=http-nio-80-exec-1}, capacity=128, totalAddedValues=13}, status=ImmutableStatusData{statusCode=UNSET, description=}, totalRecordedEvents=0, totalRecordedLinks=0, startEpochNanos=1724318336174660933, endEpochNanos=0}, opentelemetry-traces-span-key-http-server=SdkSpan{traceId=56dbbb51be9011d27702a74c2856d726, spanId=8b61fd0e6505a465, parentSpanContext=ImmutableSpanContext{traceId=00000000000000000000000000000000, spanId=0000000000000000, traceFlags=00, traceState=ArrayBasedTraceState{entries=[]}, remote=false, valid=false}, name=GET, kind=SERVER, attributes=AttributesMap{data={server.port=80, server.address=xxx, client.address=xxx, origin.component=io.opentelemetry.tomcat-7.0, url.path=/actuator/info, component=tomcat, span.kind=SERVER, http.request.method=GET, thread.id=69, operation=GET, user_agent.original=xxx, url.scheme=http, thread.name=http-nio-80-exec-1}, capacity=128, totalAddedValues=13}, status=ImmutableStatusData{statusCode=UNSET, description=}, totalRecordedEvents=0, totalRecordedLinks=0, startEpochNanos=1724318336174660933, endEpochNanos=0}}
[otel.javaagent 2024-08-22 17:18:56:191 +0800] [http-nio-80-exec-1] DEBUG io.opentelemetry.javaagent.tooling.AgentInstaller$TransformLoggingListener - Transformed org.apache.catalina.connector.CoyoteOutputStream -- org.springframework.boot.loader.LaunchedURLClassLoader@7675c171
[otel.javaagent 2024-08-22 17:18:56:200 +0800] [http-nio-80-exec-1] DEBUG io.opentelemetry.javaagent.tooling.AgentInstaller$TransformLoggingListener - Transformed javax.servlet.http.HttpServletRequest -- org.springframework.boot.loader.LaunchedURLClassLoader@7675c171
[otel.javaagent 2024-08-22 17:18:56:203 +0800] [http-nio-80-exec-1] DEBUG io.opentelemetry.javaagent.tooling.AgentInstaller$TransformLoggingListener - Transformed org.apache.catalina.connector.RequestFacade -- org.springframework.boot.loader.LaunchedURLClassLoader@7675c171
[otel.javaagent 2024-08-22 17:18:56:294 +0800] [http-nio-80-exec-1] DEBUG io.opentelemetry.javaagent.tooling.AgentInstaller$TransformLoggingListener - Transformed org.apache.catalina.connector.ResponseFacade -- org.springframework.boot.loader.LaunchedURLClassLoader@7675c171
[otel.javaagent 2024-08-22 17:18:56:304 +0800] [supportability_metrics_reporter] DEBUG io.opentelemetry.javaagent.shaded.instrumentation.api.internal.SupportabilityMetrics - Suppressed Spans by 'io.opentelemetry.tomcat-10.0' (SERVER) : 1

The place where print the parentContext log ():

static final class BySpanKey implements SpanSuppressor { 

 ....
@Override
    public boolean shouldSuppress(Context parentContext, SpanKind spanKind) {
      logger.log(Level.INFO, "parentContext:" + parentContext);
      for (SpanKey spanKey : spanKeys) {
        if (spanKey.fromContextOrNull(parentContext) == null) {
          return false;
        }
      }
      return true;
    }
...

When I remove the Tomcat 7 instrumentation(-Dotel.instrumentation.tomcat-7.0.enabled=false), everything becomes normal.
How should I locate this problem?

[laurit]

It could happen when your spring boot application contains both javax and jakarta servlet api. This issue has been fixed in the latest release (check release notes to find the exact release with the fix).

[huange7]

i see. thank for your help!