Skip to content

Conversation

@psainics
Copy link
Contributor

@psainics psainics commented Nov 20, 2024

Raising a different PR for bump up, since this breaks unit tests.

Error Logs ( when running unit teste [GenericDatabasePluginTestBase] )

Exception in thread "MapReduceRunner-phase-1" java.lang.RuntimeException: java.lang.Exception: java.lang.NoSuchMethodError: org.apache.hadoop.mapreduce.task.JobContextImpl.getCacheArchives(Lorg/apache/hadoop/conf/Configuration;)[Ljava/net/URI;
	at com.google.common.base.Throwables.propagate(Throwables.java:160)
	at com.google.common.util.concurrent.AbstractExecutionThreadService$1$1.run(AbstractExecutionThreadService.java:69)
	at io.cdap.cdap.internal.app.runtime.batch.MapReduceRuntimeService$2$1.run(MapReduceRuntimeService.java:453)
	at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.Exception: java.lang.NoSuchMethodError: org.apache.hadoop.mapreduce.task.JobContextImpl.getCacheArchives(Lorg/apache/hadoop/conf/Configuration;)[Ljava/net/URI;
	at io.cdap.cdap.internal.app.runtime.batch.MapReduceRuntimeService.startUp(MapReduceRuntimeService.java:370)
	at com.google.common.util.concurrent.AbstractExecutionThreadService$1$1.run(AbstractExecutionThreadService.java:47)
	... 2 more
Caused by: java.lang.NoSuchMethodError: org.apache.hadoop.mapreduce.task.JobContextImpl.getCacheArchives(Lorg/apache/hadoop/conf/Configuration;)[Ljava/net/URI;
	at org.apache.hadoop.mapreduce.v2.util.MRApps.setupDistributedCache(MRApps.java:487)
	at org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(LocalDistributedCacheManager.java:92)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobRunner.java:172)
	at org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:794)
	at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
	at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
	at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
	at io.cdap.cdap.internal.app.runtime.batch.MapReduceRuntimeService.startUp(MapReduceRuntimeService.java:356)
	... 3 more

@psainics psainics added the build label Nov 20, 2024
@psainics psainics self-assigned this Nov 20, 2024
@psainics
Copy link
Contributor Author

Fixed Unit Tests by bumping up hadoop.version to 3.3.6 .

@psainics psainics merged commit b4b3db2 into data-integrations:develop Nov 21, 2024
9 checks passed
@psainics psainics deleted the bump/cdap-version branch November 21, 2024 07:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants