Exception: NoSuchMethodError: com.google.common.base.Enums.valueOfFunction

[DawnJheng]

Hello, when I use JDK8 to build Gravitino's integration test, I encounter an error. It seems that Hadoop is using an outdated version of Guava. Have any of you experienced a similar issue?

2024-01-31 14:58:28 ERROR RetryingHMSHandler:204 - java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.fs.shell.XAttrCommands$GetfattrCommand
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:133)
	at org.apache.hadoop.fs.shell.CommandFactory.getInstance(CommandFactory.java:125)
	at org.apache.hadoop.fs.shell.CommandFactory.getInstance(CommandFactory.java:109)
	at org.apache.hadoop.fs.FsShell.printInfo(FsShell.java:224)
	at org.apache.hadoop.fs.FsShell.printUsage(FsShell.java:187)
	at org.apache.hadoop.fs.FsShell.run(FsShell.java:328)
	at org.apache.hadoop.hive.io.HdfsUtils.run(HdfsUtils.java:201)
	at org.apache.hadoop.hive.io.HdfsUtils.setFullFileStatus(HdfsUtils.java:124)
	at org.apache.hadoop.hive.io.HdfsUtils.setFullFileStatus(HdfsUtils.java:94)
	at org.apache.hadoop.hive.io.HdfsUtils.setFullFileStatus(HdfsUtils.java:77)
	at org.apache.hadoop.hive.common.FileUtils.mkdir(FileUtils.java:544)
	at org.apache.hadoop.hive.metastore.Warehouse.mkdirs(Warehouse.java:194)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_database_core(HiveMetaStore.java:880)
	at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_database(HiveMetaStore.java:939)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:148)
	at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
	at com.sun.proxy.$Proxy33.create_database(Unknown Source)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_database.getResult(ThriftHiveMetastore.java:10787)
	at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_database.getResult(ThriftHiveMetastore.java:10771)
	at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
	at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
	at org.apache.hadoop.hive.metastore.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:48)
	at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	at java.lang.Thread.run(Thread.java:750)
Caused by: java.lang.ExceptionInInitializerError: Exception java.lang.NoSuchMethodError: com.google.common.base.Enums.valueOfFunction(Ljava/lang/Class;)Lcom/google/common/base/Function; [in thread "pool-9-thread-1"]
	at org.apache.hadoop.fs.shell.XAttrCommands$GetfattrCommand.<clinit>(XAttrCommands.java:69)
	... 34 more
 

[yuqi1129]

@DawnJheng
Thank you for your report. Could you please paste the JDK version(java --version), OS system and other information here?

[DawnJheng]

[Apple silicon]Apple M1 Pro
OS: macOS Sonoma 14.2.1

java version "1.8.0_381"
Java(TM) SE Runtime Environment (build 1.8.0_381-b09)
Java HotSpot(TM) 64-Bit Server VM (build 25.381-b09, mixed mode)

[DawnJheng]

Failed tests:

TestCachedClientPool. initializationError
TestHiveCatalog. initializationError
TestHiveSchema. initializationError
TestHiveTable. initializationError

[yuqi1129]

What command do you use to to build Gravitino's integration test?

[DawnJheng]

./gradlew build

[yuqi1129]

I'll check it locally and respond soon.

[mchades]

Can you pull the latest code and try again?

[charliecheng630]

I solved the problem by following steps：

1. rm -rf ~/.gradle/caches/modules-2
2. clean dir gravitino/.idea
3. Re-import the project by IntelliJ.