Issue with Distributed Testing in Kubernetes Using JMeter DSL #289

raghuwar · 2024-12-20T22:05:21Z

raghuwar
Dec 20, 2024

Description of the Problem
I am running a JMeter DSL-based performance test using a Distributed Testing setup in Kubernetes. The test aims to perform a simple load scenario with httpSampler requests. However, when executed on a Worker Node, I receive the following error related to JEXL2 function execution.

Test Code Example
Here is the Java-based JMeter DSL test code I am trying to execute:

import static org.assertj.core.api.Assertions.assertThat;
import static us.abstracta.jmeter.javadsl.JmeterDsl.*;

import java.io.IOException;
import java.time.Duration;
import org.apache.jmeter.threads.JMeterVariables;
import org.apache.http.entity.ContentType;
import org.junit.jupiter.api.Test;
import us.abstracta.jmeter.javadsl.core.TestPlanStats;

public class PerformanceTest {

@test
public void testPerformance() throws IOException {
TestPlanStats stats = testPlan(
threadGroup(2, 10,
httpSampler("http://my.service")
.post(s -> buildRequestBody(s.vars), ContentType.TEXT_PLAIN)
)
).run();
assertThat(stats.overall().sampleTimePercentile99()).isLessThan(Duration.ofSeconds(5));
}

public static String buildRequestBody(JMeterVariables vars) {
String countVarName = "REQUEST_COUNT";
Integer countVar = (Integer) vars.getObject(countVarName);
int count = countVar != null ? countVar + 1 : 1;
vars.putObject(countVarName, count);
return "MyBody" + count;
}
}

Error Details
When running the above code in JMeter DSL Distributed Testing on Kubernetes, I get the following error on one of the Worker Nodes:

2024-12-20 17:52:26,532 ERROR o.a.j.f.Jexl2Function: An error occurred while evaluating the expression "props.get('lambdaScript1').run(new('us.abstracta.jmeter.javadsl.core.util.PropertyScriptBuilder$PropertyScriptVars',ctx,log))"

org.apache.commons.jexl2.JexlException: org.apache.jmeter.functions.Jexl2Function.execute@94![27,128]: 'props.get('lambdaScript1').run(new ('us.abstracta.jmeter.javadsl.core.util.PropertyScriptBuilder$PropertyScriptVars', ctx, log));' attempting to call method on null
at org.apache.commons.jexl2.Interpreter.visit(Interpreter.java:1095) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.parser.ASTMethodNode.jjtAccept(ASTMethodNode.java:18) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.Interpreter.visit(Interpreter.java:1317) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.parser.ASTReference.jjtAccept(ASTReference.java:18) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.Interpreter.visit(Interpreter.java:946) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.parser.ASTJexlScript.jjtAccept(ASTJexlScript.java:38) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.Interpreter.interpret(Interpreter.java:232) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.ExpressionImpl.execute(ExpressionImpl.java:107) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.jmeter.functions.Jexl2Function.execute(Jexl2Function.java:95) ~[ApacheJMeter_functions.jar:5.5]
at org.apache.jmeter.engine.util.CompoundVariable.execute(CompoundVariable.java:138) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.engine.util.CompoundVariable.execute(CompoundVariable.java:113) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.testelement.property.FunctionProperty.getStringValue(FunctionProperty.java:100) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.testelement.AbstractTestElement.getPropertyAsString(AbstractTestElement.java:280) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.config.Argument.getValue(Argument.java:145) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.protocol.http.util.HTTPArgument.getEncodedValue(HTTPArgument.java:249) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.util.HTTPArgument.getEncodedValue(HTTPArgument.java:230) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.sampler.HTTPHC4Impl.setupHttpEntityEnclosingRequestData(HTTPHC4Impl.java:1653) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.sampler.HTTPHC4Impl.handleMethod(HTTPHC4Impl.java:890) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.sampler.HTTPHC4Impl.sample(HTTPHC4Impl.java:645) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.sampler.HTTPSamplerProxy.sample(HTTPSamplerProxy.java:66) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.sampler.HTTPSamplerBase.sample(HTTPSamplerBase.java:1301) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.sampler.HTTPSamplerBase.sample(HTTPSamplerBase.java:1290) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.threads.JMeterThread.doSampling(JMeterThread.java:651) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.threads.JMeterThread.executeSamplePackage(JMeterThread.java:570) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.threads.JMeterThread.processSampler(JMeterThread.java:501) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.threads.JMeterThread.run(JMeterThread.java:268) ~[ApacheJMeter_core.jar:5.5]
at java.lang.Thread.run(Thread.java:833) ~[?:?]
2024-12-20 17:52:26,537 ERROR o.a.j.f.Jexl2Function: An error occurred while evaluating the expression "props.get('lambdaScript1').run(new('us.abstracta.jmeter.javadsl.core.util.PropertyScriptBuilder$PropertyScriptVars',ctx,log))"

The stack trace points to an issue with the props.get method, which seems to be related to the use of a lambda function or PropertyScriptBuilder internally in the JMeter DSL.

Observations
The error occurs only in the distributed environment on the worker nodes. Running the same test in a local standalone environment works fine.

I am not sure what I am missing, other examples are working fine, if I remove lambda usage its working.

Request for Help
Has anyone encountered this kind of error while running JMeter DSL tests in Kubernetes Distributed Testing?
Is there a known limitation of lambda expressions or scripting in distributed mode?
Are there any recommended workarounds to avoid this error, such as changes in test script design or specific JMeter DSL configurations?

Environment Details
JMeter Version: 5.5
JMeter DSL Version: v1.29.1
Kubernetes Environment: Minikube
Java Version: 17

Any insights or suggestions from the community would be highly appreciated! Thank you in advance.

Answered by raghuwar

Dec 23, 2024

After reading other section of the documents along with the lambda section, made small changes and it seems its working.
Thanks @rabelenda for quick help.

import org.apache.commons.io.FileUtils;
import org.apache.http.entity.ContentType;
import org.apache.jmeter.processor.PreProcessor;
import org.apache.jmeter.protocol.http.util.HTTPConstants;
import org.apache.jmeter.protocol.java.sampler.JavaSampler;
import org.apache.jmeter.threads.JMeterContextService;
import org.apache.jmeter.threads.JMeterVariables;
import org.junit.jupiter.api.Test;
import org.springframework.beans.factory.annotation.Value;
import org.springframework.boot.test.context.SpringBootTest;
import org.springframework.test…

View full answer

rabelenda · 2024-12-20T22:19:47Z

rabelenda
Dec 20, 2024
Maintainer

Hello, thank you for trying and reporting a detailed description of the issue.

Have you tried including jmeter-java-dsl library in the jmeter libs path of the worker nodes?

1 reply

raghuwar Dec 20, 2024
Author

Thanks for quick reply.
Yes, I have already added the jmeter-java-dsl library in the container image along with other jmeter-java-dsl-* jars, and it is present in JMeter's lib/ext path.

rabelenda · 2024-12-20T23:03:07Z

rabelenda
Dec 20, 2024
Maintainer

You need also to package the code containing the lambda (probably your test classes) and include it in the workers jmeter library path.

5 replies

rabelenda Dec 21, 2024
Maintainer

Have you tried following the instructions described here?

raghuwar Dec 22, 2024
Author

I reconfigured everything and created a small test project with below test class, all worker nodes have all jmeter-java-dsl-* dependency along with jar that contains below class in lib/ext
Utilized this link to create static class and test-class jars.

import org.apache.http.entity.ContentType;
import org.junit.jupiter.api.Test;
import org.springframework.beans.factory.annotation.Value;
import org.springframework.boot.test.context.SpringBootTest;
import org.springframework.test.context.TestPropertySource;
import us.abstracta.jmeter.javadsl.core.TestPlanStats;
import us.abstracta.jmeter.javadsl.core.engines.DistributedJmeterEngine;
import us.abstracta.jmeter.javadsl.core.preprocessors.DslJsr223PreProcessor;

import java.io.IOException;
import java.time.Instant;
import java.util.concurrent.TimeoutException;

import static us.abstracta.jmeter.javadsl.JmeterDsl.*;

@SpringBootTest
@TestPropertySource("classpath:test.properties")
public class CodeBytesTest {

    @Value("${jmeter.svc.name}")
    String jmeterService;

    public static class PreprocessSamplerBody implements DslJsr223PreProcessor.PreProcessorScript{

        @Override
        public void runScript(DslJsr223PreProcessor.PreProcessorVars vars) throws Exception {
            String value = "{Testing:\"abc\"}";
            vars.vars.put("REQUEST_BODY", value);
        }
    }

    @Test
    public void testPerformance_1() throws IOException, InterruptedException, TimeoutException {
        String value = "{Testing:\"abc\"}";
        TestPlanStats helloWorld = testPlan(
                threadGroup(1,1,
                        httpSampler("https://httpbin.org/post")
//                                .post(body -> body.vars.get("REQUEST_BODY"), ContentType.APPLICATION_JSON)
                                .post(vars("REQUEST_BODY").toString(), ContentType.APPLICATION_JSON)
                        .children(
                                jsr223PreProcessor(PreprocessSamplerBody.class)
                        )
                ),
                jtlWriter("target/jtl/Test" + Instant.now().toString().replace(":","-") + ".jtl")
//        ).run();
        ).runIn(new DistributedJmeterEngine(jmeterService));
    }
}

Error on Worker Node in jmeter logs

2024-12-22 02:41:14,610 INFO o.a.j.t.ThreadGroup: Started thread group number 1
2024-12-22 02:41:14,610 INFO o.a.j.e.StandardJMeterEngine: All thread groups have been started
2024-12-22 02:41:14,617 INFO o.a.j.t.JMeterThread: Thread started: jmeter-slaves-svc-Thread Group 1-1
2024-12-22 02:41:14,623 INFO o.a.j.p.h.s.HTTPHCAbstractImpl: Local host = jmeter-slaves-58d7c95df4-f4q7c
2024-12-22 02:41:14,625 INFO o.a.j.p.h.s.HTTPHC4Impl: HTTP request retry count = 0
2024-12-22 02:41:14,626 INFO o.a.j.s.SampleResult: Note: Sample TimeStamps are START times
2024-12-22 02:41:14,626 INFO o.a.j.s.SampleResult: sampleresult.default.encoding is set to ISO-8859-1
2024-12-22 02:41:14,626 INFO o.a.j.s.SampleResult: sampleresult.useNanoTime=true
2024-12-22 02:41:14,626 INFO o.a.j.s.SampleResult: sampleresult.nanoThreadSleep=5000
2024-12-22 02:41:14,686 ERROR o.a.j.f.Jexl2Function: An error occurred while evaluating the expression "props.get('lambdaScript1').run(new('us.abstracta.jmeter.javadsl.core.util.PropertyScriptBuilder$PropertyScriptVars',ctx,log))"

org.apache.commons.jexl2.JexlException: org.apache.jmeter.functions.Jexl2Function.execute@94![27,128]: 'props.get('lambdaScript1').run(new ('us.abstracta.jmeter.javadsl.core.util.PropertyScriptBuilder$PropertyScriptVars', ctx, log));' attempting to call method on null
at org.apache.commons.jexl2.Interpreter.visit(Interpreter.java:1095) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.parser.ASTMethodNode.jjtAccept(ASTMethodNode.java:18) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.Interpreter.visit(Interpreter.java:1317) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.parser.ASTReference.jjtAccept(ASTReference.java:18) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.Interpreter.visit(Interpreter.java:946) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.parser.ASTJexlScript.jjtAccept(ASTJexlScript.java:38) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.Interpreter.interpret(Interpreter.java:232) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.commons.jexl2.ExpressionImpl.execute(ExpressionImpl.java:107) ~[commons-jexl-2.1.1.jar:2.1.1]
at org.apache.jmeter.functions.Jexl2Function.execute(Jexl2Function.java:95) ~[ApacheJMeter_functions.jar:5.5]
at org.apache.jmeter.engine.util.CompoundVariable.execute(CompoundVariable.java:138) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.engine.util.CompoundVariable.execute(CompoundVariable.java:113) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.testelement.property.FunctionProperty.getStringValue(FunctionProperty.java:100) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.testelement.AbstractTestElement.getPropertyAsString(AbstractTestElement.java:280) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.config.Argument.getValue(Argument.java:145) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.protocol.http.util.HTTPArgument.getEncodedValue(HTTPArgument.java:249) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.util.HTTPArgument.getEncodedValue(HTTPArgument.java:230) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.sampler.HTTPHC4Impl.setupHttpEntityEnclosingRequestData(HTTPHC4Impl.java:1653) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.sampler.HTTPHC4Impl.handleMethod(HTTPHC4Impl.java:890) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.sampler.HTTPHC4Impl.sample(HTTPHC4Impl.java:645) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.sampler.HTTPSamplerProxy.sample(HTTPSamplerProxy.java:66) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.sampler.HTTPSamplerBase.sample(HTTPSamplerBase.java:1301) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.protocol.http.sampler.HTTPSamplerBase.sample(HTTPSamplerBase.java:1290) ~[ApacheJMeter_http.jar:5.5]
at org.apache.jmeter.threads.JMeterThread.doSampling(JMeterThread.java:651) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.threads.JMeterThread.executeSamplePackage(JMeterThread.java:570) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.threads.JMeterThread.processSampler(JMeterThread.java:501) ~[ApacheJMeter_core.jar:5.5]
at org.apache.jmeter.threads.JMeterThread.run(JMeterThread.java:268) ~[ApacheJMeter_core.jar:5.5]
at java.lang.Thread.run(Thread.java:1583) ~[?:?]
2024-12-22 02:41:14,756 INFO o.a.j.p.h.s.h.LazyLayeredConnectionSocketFactory: Setting up HTTPS TrustAll Socket Factory
2024-12-22 02:41:14,760 INFO o.a.j.u.JsseSSLManager: Using default SSL protocol: TLS
2024-12-22 02:41:14,760 INFO o.a.j.u.JsseSSLManager: SSL session context: per-thread

raghuwar Dec 22, 2024
Author

Also checked that this "us.abstracta.jmeter.javadsl.core.util.PropertyScriptBuilder" class is in worker nodes jmeter classpath or not, and its part of it.

-rw-r--r-- 1 root root    11016 Dec 22 02:07 JMeterNinja-0.0.1-SNAPSHOT-tests.jar
root@jmeter-slaves-58d7c95df4-r92pl:/jmeter/apache-jmeter-5.5/lib/ext# for files in *.jar; do jar tvf $files | grep -i "us.abstracta.jmeter.javadsl.core.util.PropertyScriptBuilder"; done;
   654 Wed Oct 16 13:06:04 UTC 2024 us/abstracta/jmeter/javadsl/core/util/PropertyScriptBuilder$PropertyScript.class
  1611 Wed Oct 16 13:06:04 UTC 2024 us/abstracta/jmeter/javadsl/core/util/PropertyScriptBuilder$PropertyScriptVars.class
  3398 Wed Oct 16 13:06:04 UTC 2024 us/abstracta/jmeter/javadsl/core/util/PropertyScriptBuilder.class
root@jmeter-slaves-58d7c95df4-r92pl:/jmeter/apache-jmeter-5.5/lib/ext#

raghuwar Dec 23, 2024
Author

After reading other section of the documents along with the lambda section, made small changes and it seems its working.
Thanks @rabelenda for quick help.

import org.apache.commons.io.FileUtils;
import org.apache.http.entity.ContentType;
import org.apache.jmeter.processor.PreProcessor;
import org.apache.jmeter.protocol.http.util.HTTPConstants;
import org.apache.jmeter.protocol.java.sampler.JavaSampler;
import org.apache.jmeter.threads.JMeterContextService;
import org.apache.jmeter.threads.JMeterVariables;
import org.junit.jupiter.api.Test;
import org.springframework.beans.factory.annotation.Value;
import org.springframework.boot.test.context.SpringBootTest;
import org.springframework.test.context.TestPropertySource;
import us.abstracta.jmeter.javadsl.core.DslTestPlan;
import us.abstracta.jmeter.javadsl.core.TestPlanStats;
import us.abstracta.jmeter.javadsl.core.engines.DistributedJmeterEngine;
import us.abstracta.jmeter.javadsl.core.preprocessors.DslJsr223PreProcessor;

import java.io.File;
import java.io.IOException;
import java.time.Duration;
import java.time.Instant;
import java.util.ArrayList;
import java.util.Arrays;
import java.util.List;
import java.util.concurrent.TimeoutException;

import static org.assertj.core.api.Assertions.assertThat;
import static us.abstracta.jmeter.javadsl.JmeterDsl.*;

@SpringBootTest
@TestPropertySource("classpath:test.properties")
public class CodeBytesTest {

    @Value("${jmeter.svc.name}")
    String jmeterService;

    public static class RequestBodyGenerator implements DslJsr223PreProcessor.PreProcessorScript {

        @Override
        public void runScript(DslJsr223PreProcessor.PreProcessorVars vars) throws Exception {
            Integer countVarVal = (Integer) vars.vars.getObject("REQUEST_COUNT");
            vars.vars.putObject("REQUEST_COUNT", countVarVal != null ? countVarVal + 1 : 1);

        }
    }

    @Test
    public void testPerformance_1() throws IOException, InterruptedException, TimeoutException {
        String bodyPrefix = "body";
        String countVarName = "REQUEST_COUNT";
        DslTestPlan testPlan = testPlan(
                threadGroup(5,5,
                        httpSampler("https://httpbin.org/post")
                                .post(bodyPrefix + "${REQUEST_COUNT}", ContentType.TEXT_PLAIN)
                                .children(jsr223PreProcessor(RequestBodyGenerator.class))
                ),
                jtlWriter("target/jtls")
                        .saveAsXml(true)
                        .withAllFields(true)
        );

        if(null != jmeterService && !jmeterService.isEmpty()) {
            testPlan.runIn(new DistributedJmeterEngine(jmeterService.split(",")));
        }else{
            testPlan.run();
        }
    }
}

Answer selected by raghuwar

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Issue with Distributed Testing in Kubernetes Using JMeter DSL #289

Uh oh!

{{title}}

Uh oh!

Replies: 2 comments 6 replies

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Uh oh!

{{title}}

Uh oh!

Select a reply

Uh oh!

Issue with Distributed Testing in Kubernetes Using JMeter DSL #289

Uh oh!

raghuwar Dec 20, 2024

Replies: 2 comments · 6 replies

Uh oh!

rabelenda Dec 20, 2024 Maintainer

Uh oh!

raghuwar Dec 20, 2024 Author

Uh oh!

rabelenda Dec 20, 2024 Maintainer

Uh oh!

rabelenda Dec 21, 2024 Maintainer

Uh oh!

raghuwar Dec 22, 2024 Author

Uh oh!

raghuwar Dec 22, 2024 Author

Uh oh!

raghuwar Dec 23, 2024 Author

raghuwar
Dec 20, 2024

Replies: 2 comments 6 replies

rabelenda
Dec 20, 2024
Maintainer

raghuwar Dec 20, 2024
Author

rabelenda
Dec 20, 2024
Maintainer

rabelenda Dec 21, 2024
Maintainer

raghuwar Dec 22, 2024
Author

raghuwar Dec 22, 2024
Author

raghuwar Dec 23, 2024
Author