作者小头像 Lv.1
0 成长值

个人介绍

这个人很懒,什么都没有留下

感兴趣或擅长的领域

暂无数据
个人勋章
TA还没获得勋章~
成长雷达
0
0
0
0
0

个人资料

个人介绍

这个人很懒,什么都没有留下

感兴趣或擅长的领域

暂无数据

达成规则

发布时间 2020/05/11 18:58:45 最后回复 全棧工程师-lsj 2020/07/09 14:57:07 版块 鲲鹏BoostKit
10388 15 1
发布时间 2020/05/11 18:58:45 最后回复 全棧工程师-lsj 2020/07/09 14:57:07 版块 鲲鹏BoostKit
10388 15 1
发布时间 2020/05/11 18:58:45 最后回复 全棧工程师-lsj 2020/07/09 14:57:07 版块 鲲鹏BoostKit
10388 15 1
他的回复:
运行presto连接hive报错:2020-07-09T13:27:01.995+0800    ERROR   main    com.facebook.presto.server.PrestoServer nulljava.lang.ExceptionInInitializerError        at com.facebook.presto.hive.HdfsEnvironment$$FastClassByGuice$$a9f55374.newInstance()        at com.google.inject.internal.DefaultConstructionProxyFactory$FastClassProxy.newInstance(DefaultConstructionProxyFactory.java:89)        at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:114)        at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:91)        at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:306)        at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)        at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:148)        at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:39)        at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:42)        at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:65)        at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:113)        at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:91)        at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:306)        at com.google.inject.internal.FactoryProxy.get(FactoryProxy.java:62)        at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)        at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:148)        at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:39)        at com.google.inject.internal.InternalInjectorCreator.loadEagerSingletons(InternalInjectorCreator.java:211)        at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:182)        at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:109)        at com.google.inject.Guice.createInjector(Guice.java:87)        at io.airlift.bootstrap.Bootstrap.initialize(Bootstrap.java:240)        at com.facebook.presto.hive.HiveConnectorFactory.create(HiveConnectorFactory.java:120)        at com.facebook.presto.connector.ConnectorManager.createConnector(ConnectorManager.java:319)        at com.facebook.presto.connector.ConnectorManager.addCatalogConnector(ConnectorManager.java:195)        at com.facebook.presto.connector.ConnectorManager.createConnection(ConnectorManager.java:187)        at com.facebook.presto.connector.ConnectorManager.createConnection(ConnectorManager.java:173)        at com.facebook.presto.metadata.StaticCatalogStore.loadCatalog(StaticCatalogStore.java:96)        at com.facebook.presto.metadata.StaticCatalogStore.loadCatalogs(StaticCatalogStore.java:74)        at com.facebook.presto.server.PrestoServer.run(PrestoServer.java:119)        at com.facebook.presto.server.PrestoServer.main(PrestoServer.java:67)Caused by: java.lang.RuntimeException: failed to load Hadoop native library        at com.facebook.presto.hadoop.HadoopNative.requireHadoopNative(HadoopNative.java:58)        at com.facebook.presto.hive.HdfsEnvironment.(HdfsEnvironment.java:37)        ... 31 moreCaused by: java.lang.RuntimeException: native snappy library not available: this version of libhadoop was built without snappy support.        at org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:65)        at org.apache.hadoop.io.compress.SnappyCodec.getDecompressorType(SnappyCodec.java:193)        at com.facebook.presto.hadoop.HadoopNative.loadAllCodecs(HadoopNative.java:71)        at com.facebook.presto.hadoop.HadoopNative.requireHadoopNative(HadoopNative.java:52)        ... 32 more"2.2.2        libhadoop.so移植"这步哪里有问题吗?补充:"2.2.2        libhadoop.so移植"编译前,添加如下步骤:yum - y install snappy snappy-devel编译使用如下命令:mvn package -Pnative -Drequire.snappy=true -Dboundle.snappy=/lib64 -DskipTests -Dmaven.javadoc.skip=true已验证
发布时间 2020/05/11 18:58:45 最后回复 全棧工程师-lsj 2020/07/09 14:57:07 版块 鲲鹏BoostKit
10388 15 1
他的回复:
编译的presto版本是0.211运行presto连接hive时报错如下:2020-07-09T11:24:22.036+0800    ERROR   main    com.facebook.presto.server.PrestoServer nulljava.lang.ExceptionInInitializerError        at com.facebook.presto.hive.HdfsEnvironment$$FastClassByGuice$$a9f55374.newInstance()        at com.google.inject.internal.DefaultConstructionProxyFactory$FastClassProxy.newInstance(DefaultConstructionProxyFactory.java:89)        at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:114)        at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:91)        at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:306)        at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)        at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:148)        at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:39)        at com.google.inject.internal.SingleParameterInjector.inject(SingleParameterInjector.java:42)        at com.google.inject.internal.SingleParameterInjector.getAll(SingleParameterInjector.java:65)        at com.google.inject.internal.ConstructorInjector.provision(ConstructorInjector.java:113)        at com.google.inject.internal.ConstructorInjector.construct(ConstructorInjector.java:91)        at com.google.inject.internal.ConstructorBindingImpl$Factory.get(ConstructorBindingImpl.java:306)        at com.google.inject.internal.FactoryProxy.get(FactoryProxy.java:62)        at com.google.inject.internal.ProviderToInternalFactoryAdapter.get(ProviderToInternalFactoryAdapter.java:40)        at com.google.inject.internal.SingletonScope$1.get(SingletonScope.java:148)        at com.google.inject.internal.InternalFactoryToProviderAdapter.get(InternalFactoryToProviderAdapter.java:39)        at com.google.inject.internal.InternalInjectorCreator.loadEagerSingletons(InternalInjectorCreator.java:211)        at com.google.inject.internal.InternalInjectorCreator.injectDynamically(InternalInjectorCreator.java:182)        at com.google.inject.internal.InternalInjectorCreator.build(InternalInjectorCreator.java:109)        at com.google.inject.Guice.createInjector(Guice.java:87)        at io.airlift.bootstrap.Bootstrap.initialize(Bootstrap.java:240)        at com.facebook.presto.hive.HiveConnectorFactory.create(HiveConnectorFactory.java:120)        at com.facebook.presto.connector.ConnectorManager.createConnector(ConnectorManager.java:319)        at com.facebook.presto.connector.ConnectorManager.addCatalogConnector(ConnectorManager.java:195)        at com.facebook.presto.connector.ConnectorManager.createConnection(ConnectorManager.java:187)        at com.facebook.presto.connector.ConnectorManager.createConnection(ConnectorManager.java:173)        at com.facebook.presto.metadata.StaticCatalogStore.loadCatalog(StaticCatalogStore.java:96)        at com.facebook.presto.metadata.StaticCatalogStore.loadCatalogs(StaticCatalogStore.java:74)        at com.facebook.presto.server.PrestoServer.run(PrestoServer.java:119)        at com.facebook.presto.server.PrestoServer.main(PrestoServer.java:67)Caused by: java.lang.RuntimeException: failed to load Hadoop native library        at com.facebook.presto.hadoop.HadoopNative.requireHadoopNative(HadoopNative.java:58)        at com.facebook.presto.hive.HdfsEnvironment.(HdfsEnvironment.java:37)        ... 31 moreCaused by: java.lang.RuntimeException: library not found: /nativelib/Linux-aarch64/libhadoop.so        at com.facebook.presto.hadoop.HadoopNative.loadLibrary(HadoopNative.java:88)        at com.facebook.presto.hadoop.HadoopNative.requireHadoopNative(HadoopNative.java:47)        ... 32 more2020-07-09T11:24:22.037+0800    INFO    Thread-92       io.airlift.bootstrap.LifeCycleManager   Life cycle stopping..."2.3      presto-hadoop-apache2-2.7.4-5移植"步骤,在本地仓库中/root/.m2/repository/com/facebook/presto/hadoop/hadoop-apache2/2.7.4-5/hadoop-apache2-2.7.4-5.jar的resources目录中包含/nativelib/Linux-aarch64/libhadoop.so文件 发现编译完的/usr/lib/presto/lib/plugin/hive-hadoop2目录中使用的是hadoop-apache2-2.7.4-3.jar总结:编译presto 0.211版本,需要移植presto-hadoop-apache2-2.7.4-3版本重新编译presto-hadoop-apache2-2.7.4-3后,再次重新编译presto 0.211后问题解决
发布时间 2020/05/11 18:58:45 最后回复 全棧工程师-lsj 2020/07/09 14:57:07 版块 鲲鹏BoostKit
10388 15 1
他的回复:
安装rpm包时,报如下错误,要怎么解决,按照文件的步骤编译的是0.211版本的。[root@hdp102 ~]# yum -y install presto-server-rpm-0.211.aarch64.rpmLoaded plugins: fastestmirrorExamining presto-server-rpm-0.211.aarch64.rpm: presto-server-rpm-0.211-1.noarchMarking presto-server-rpm-0.211.aarch64.rpm to be installedResolving Dependencies--> Running transaction check---> Package presto-server-rpm.noarch 0:0.211-1 will be installed--> Finished Dependency ResolutionDependencies Resolved========================================================================================================================================= Package                           Arch                   Version                 Repository                                        Size=========================================================================================================================================Installing: presto-server-rpm                 noarch                 0.211-1                 /presto-server-rpm-0.211.aarch64                 596 MTransaction Summary=========================================================================================================================================Install  1 PackageTotal size: 596 MInstalled size: 596 MDownloading packages:Running transaction checkRunning transaction testTransaction test succeededRunning transaction+======================================================================+|      Error: Required Java version could not be found                 |+----------------------------------------------------------------------+| Please download the latest Oracle JDK/JRE from the Java web site     ||       > http://www.oracle.com/technetwork/java/javase/downloads     ||                                                                      || Presto requires Java 1.8 update 151 (8u151)                            || NOTE: This script will attempt to find Java whether you install      ||       using the binary or the RPM based installer.                   |+======================================================================+error: %pre(presto-server-rpm-0:0.211-1.noarch) scriptlet failed, exit status 1Error in PREIN scriptlet in rpm package presto-server-rpm-0.211-1.noarch  Verifying  : presto-server-rpm-0.211-1.noarch                                                                                      1/1Failed:  presto-server-rpm.noarch 0:0.211-1                                                                                                     Complete!
发布时间 2020/05/11 18:58:45 最后回复 全棧工程师-lsj 2020/07/09 14:57:07 版块 鲲鹏BoostKit
10388 15 1
他的回复:
"2.3      presto-hadoop-apache2-2.7.4-5移植"步骤,mvn install报错如下:------------------------------------------------------- T E S T S-------------------------------------------------------Running TestSuiteConfiguring TestNG with: org.apache.maven.surefire.testng.conf.TestNGMapConfigurator@156643d4Tests run: 11, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 0.808 sec FAILURE!testCodecRoundTrip(com.facebook.presto.hadoop.TestHadoopNative)  Time elapsed: 0.002 sec  FAILURE!java.lang.RuntimeException: failed to load Hadoop native library        at com.facebook.presto.hadoop.HadoopNative.requireHadoopNative(HadoopNative.java:58)        at com.facebook.presto.hadoop.TestHadoopNative.testCodecRoundTrip(TestHadoopNative.java:53)Caused by: java.lang.RuntimeException: library not found: /nativelib/Linux-aarch64/libhadoop.so        at com.facebook.presto.hadoop.HadoopNative.loadLibrary(HadoopNative.java:88)        at com.facebook.presto.hadoop.HadoopNative.requireHadoopNative(HadoopNative.java:47)        ... 35 moretestNative(com.facebook.presto.hadoop.TestHadoopNative)  Time elapsed: 0 sec  FAILURE!java.lang.RuntimeException: failed to load Hadoop native library        at com.facebook.presto.hadoop.HadoopNative.requireHadoopNative(HadoopNative.java:44)        at com.facebook.presto.hadoop.TestHadoopNative.testNative(TestHadoopNative.java:41)Caused by: java.lang.RuntimeException: library not found: /nativelib/Linux-aarch64/libhadoop.so        at com.facebook.presto.hadoop.HadoopNative.loadLibrary(HadoopNative.java:88)        at com.facebook.presto.hadoop.HadoopNative.requireHadoopNative(HadoopNative.java:47)        at com.facebook.presto.hadoop.TestHadoopNative.testCodecRoundTrip(TestHadoopNative.java:53)        ... 34 moreResults :Failed tests:   testCodecRoundTrip(com.facebook.presto.hadoop.TestHadoopNative): failed to load Hadoop native library  testNative(com.facebook.presto.hadoop.TestHadoopNative): failed to load Hadoop native libraryTests run: 11, Failures: 2, Errors: 0, Skipped: 0[INFO] ------------------------------------------------------------------------[INFO] BUILD FAILURE[INFO] ------------------------------------------------------------------------[INFO] Total time: 23.002 s[INFO] Finished at: 2020-07-09T08:35:40+08:00[INFO] ------------------------------------------------------------------------[ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.12.4:test (default-test) on project hadoop-apache2: There are test failures.[ERROR][ERROR] Please refer to /root/presto-hadoop-apache2-2.7.4-5/target/surefire-reports for the individual test results.[ERROR] -> [Help 1][ERROR][ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.[ERROR] Re-run Maven using the -X switch to enable full debug logging.[ERROR][ERROR] For more information about the errors and possible solutions, please read the following articles:[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException使用mvn install -DskipTests编译成功,这样是否有问题?
发布时间 2020/02/07 21:51:22 最后回复 全棧工程师-lsj 2020/07/08 16:21:36 版块 鲲鹏BoostKit
3509 2 0