Quarkus Null Pointer Exception while invoking lambda from aws console for S3 Event

[parasjain27031994]

I created a lambda function using quarkus native, however if I manually invoke the lambda function via IntelliJ using AWS plugin, I get null pointer exception.

A different behavior is observed, if I upload the resultant function.zip obtained after running mvn package -Dnative -Dquarkus.native.container-build=true command to AWS, while using the aws console by passing the S3 event json in the "Test" section, the JSON is not resolved to the S3Event object, hence if I print the event I get an empty object in console.

{
    "timestamp": "2022-05-16T06:00:03.371Z",
    "sequence": 46,
    "loggerClassName": "org.jboss.logging.Logger",
    "loggerName": "com.XX.XX.FTPDocUploaderLambdaHandler",
    "level": "INFO",
    "message": "{\n  \"records\" : [ ]\n}",
    "threadName": "Lambda Thread (NORMAL)",
    "threadId": 6,
    "mdc": {},
    "ndc": "",
    "hostName": "unknown-host.unknown-domain",
    "processName": "NativeImageGeneratorRunner$JDK9Plus",
    "processId": 26
}

However if the same is invoked automatically by creating an s3 trigger it works fine.

This is hindering for debugging the lambda function locally using an IDE. Any reason why the same event json if passed manually is not getting resolved by Quarkus ?

Below is the Lambda Handler :

public class FTPDocUploaderLambdaHandler implements RequestHandler<S3Event, String> {

private static final Logger LOG = Logger.getLogger(FTPDocUploaderLambdaHandler.class);

private static final String S3_OBJECT_CREATED_PUT_EVENT = "ObjectCreated:Put";

@Inject
S3Client s3;

@Inject
ObjectMapper mapper;

@Override
public String handleRequest(S3Event event, Context context) {
    LOG.info("Received an s3 event");
    try {
        LOG.info(mapper.writerWithDefaultPrettyPrinter().writeValueAsString(event));
    } catch (JsonProcessingException e) {
        LOG.error("An error occurred {} ",e);
    }
    if (event != null && !event.getRecords().isEmpty()) {
        List<String> objectKeys = event.getRecords().stream().filter(er -> er.getEventName().equalsIgnoreCase(S3_OBJECT_CREATED_PUT_EVENT)).map(r -> {
                    return getS3Object(r.getS3().getObject().getKey(), r.getS3().getBucket().getName());
                }
        ).collect(Collectors.toList());
        return String.join(" ,", objectKeys);
    }
    return "UNSUPPORTED_EVENT";
}

private String getS3Object(String objectKey, String bucketName) {
    LOG.info("Fetching object from bucket " + bucketName + " with key " + objectKey);
    if (StringUtils.isNotBlank(objectKey) && StringUtils.isNotBlank(bucketName)) {
        GetObjectRequest request = GetObjectRequest.builder().bucket(bucketName).key(objectKey).build();
        ResponseBytes<GetObjectResponse> s3ObjectResponseStream = s3.getObjectAsBytes(request);
        String content = s3ObjectResponseStream.asUtf8String();
        LOG.info("Object Content");
        LOG.info(content);
        return content;
    }
    LOG.info("Invalid Object Key or Bucket Name");
    return "Invalid Object Key or Bucket Name";
}

}

S3 Event JSON :

 {
  "Records": [
    {
      "eventVersion": "2.1",
      "eventSource": "aws:s3",
      "awsRegion": "us-east-2",
      "eventTime": "2019-09-03T19:37:27.192Z",
      "eventName": "ObjectCreated:Put",
      "userIdentity": {
        "principalId": "AWS:AIDAINPONIXQXHT3IKHL2"
      },
      "requestParameters": {
        "sourceIPAddress": "205.255.255.255"
      },
      "responseElements": {
        "x-amz-request-id": "D82B88E5F771F645",
        "x-amz-id-2": "vlR7PnpV2Ce81l0PRw6jlUpck7Jo5ZsQjryTjKlc5aLWGVHPZLj5NeC6qMa0emYBDXOo6QBU0Wo="
      },
      "s3": {
        "s3SchemaVersion": "1.0",
        "configurationId": "828aa6fc-f7b5-4305-8584-487c791949c1",
        "bucket": {
          "name": "DOC-EXAMPLE-BUCKET",
          "ownerIdentity": {
            "principalId": "A3I5XTEXAMAI3E"
          },
          "arn": "arn:aws:s3:::lambda-artifacts-deafc19498e3f2df"
        },
        "object": {
          "key": "b21b84d653bb07b05b1e6b33684dc11b",
          "size": 1305107,
          "eTag": "b21b84d653bb07b05b1e6b33684dc11b",
          "sequencer": "0C0F6F405D6ED209E1"
        }
      }
    }
  ]
}

Exception :

java.lang.NullPointerException: java.lang.NullPointerException
java.lang.NullPointerException
{"errorMessage":"java.lang.NullPointerException","errorType":"java.lang.NullPointerException","stackTrace":["com.research.lambda.FTPDocUploaderLambdaHandler.handleRequest(FTPDocUploaderLambdaHandler.java:36)","com.XX.XX.FTPDocUploaderLambdaHandler.handleRequest(FTPDocUploaderLambdaHandler.java:20)"]}	at com.research.lambda.FTPDocUploaderLambdaHandler.handleRequest(FTPDocUploaderLambdaHandler.java:36)

After reading through the exception, it seems it is not able to resolve @Inject attribute, hence the ObjectMapper and S3Client bean are not being injected while invoking manually.

However executing over AWS the beans are resolving but the s3Evevent is not getting resolved.

Any idea, how to resolve this to be able to debug locally ?

[parasjain27031994]

Invoking locally using sam is also not able to bind the s3Event object from JSON to the handler, below are the logs from SAM local execution :

[PS C:\Users\XX\Downloads\XX-ftp-doc-uploader> sam local invoke --template target/sam.native.yaml --event s3PutEvent.json
Invoking not.used.in.provided.runtime (provided)
Decompressing C:\Users\XX\Downloads\XX-ftp-doc-uploader\target\function.zip
Image was not found.
Removing rapid images for repo public.ecr.aws/sam/emulation-provided
Building image.........................................................................................................................................................................................................................
.....................................................
Skip pulling image and use local one: public.ecr.aws/sam/emulation-provided:rapid-1.50.0-x86_64.              
                                                                                                              
Mounting C:\Users\XX\AppData\Local\Temp\tmpkbwv4bol as /var/task:ro,delegated inside runtime container
START RequestId: 00ee5bd3-6fb5-4ffe-ac29-f92b14611c32 Version: $LATEST
{
	"timestamp": "2022-05-16T06:32:45.205Z",
	"sequence": 42,
	"loggerClassName": "org.jboss.logging.Logger",
	"loggerName": "io.quarkus",
	"level": "INFO",
	"message": "xx-ftp-doc-uploader 1.0-SNAPSHOT native (powered by Quarkus 2.9.0.Final) started in 0.490s. ",
	"threadName": "main",
	"threadId": 1,
	"mdc": {},
	"ndc": "",
	"hostName": "a6acfab4b085",
	"processName": "NativeImageGeneratorRunner$JDK9Plus",
	"processId": 26
}
{
	"timestamp": "2022-05-16T06:32:45.233Z",
	"sequence": 43,
	"loggerClassName": "org.jboss.logging.Logger",
	"loggerName": "io.quarkus",
	"level": "INFO",
	"message": "Profile prod activated. ",
	"threadName": "main",
	"threadId": 1,
	"mdc": {},
	"ndc": "",
	"hostName": "a6acfab4b085",
	"processName": "NativeImageGeneratorRunner$JDK9Plus",
	"processId": 26
}
{
	"timestamp": "2022-05-16T06:32:45.233Z",
	"sequence": 44,
	"loggerClassName": "org.jboss.logging.Logger",
	"loggerName": "io.quarkus",
	"level": "INFO",
	"message": "Installed features: [amazon-lambda, amazon-s3, cdi, config-yaml]",
	"threadName": "main",
	"threadId": 1,
	"mdc": {},
	"ndc": "",
	"hostName": "a6acfab4b085",
	"processName": "NativeImageGeneratorRunner$JDK9Plus",
	"processId": 26
}
{
	"timestamp": "2022-05-16T06:32:45.29Z",
	"sequence": 45,
	"loggerClassName": "org.jboss.logging.Logger",
	"loggerName": "com.XX.lambda.FTPDocUploaderLambdaHandler",
	"level": "INFO",
	"message": "Received an s3 event",
	"threadName": "Lambda Thread (NORMAL)",
	"threadId": 6,
	"mdc": {},
	"ndc": "",
	"hostName": "a6acfab4b085",
	"processName": "NativeImageGeneratorRunner$JDK9Plus",
	"processId": 26
}
{
	"timestamp": "2022-05-16T06:32:45.3Z",
	"sequence": 46,
	"loggerClassName": "org.jboss.logging.Logger",
	"loggerName": "com.XX.lambda.FTPDocUploaderLambdaHandler",
	"level": "INFO",
	"message": "{\n  \"records\" : [ ]\n}",
	"threadName": "Lambda Thread (NORMAL)",
	"threadId": 6,
	"mdc": {},
	"ndc": "",
	"hostName": "a6acfab4b085",
	"processName": "NativeImageGeneratorRunner$JDK9Plus",
	"processId": 26
}
END RequestId: 00ee5bd3-6fb5-4ffe-ac29-f92b14611c32
REPORT RequestId: 00ee5bd3-6fb5-4ffe-ac29-f92b14611c32  Init Duration: 0.10 ms  Duration: 928.23 ms     Billed Duration: 929 ms Memory Size: 128 MB     Max Memory Used: 128 MB
"UNSUPPORTED_EVENT"](url)