建议使用以下浏览器,以获得最佳体验。 IE 9.0+以上版本 Chrome 31+ 谷歌浏览器 Firefox 30+ 火狐浏览器
请选择 进入手机版 | 继续访问电脑版
设置昵称

在此一键设置昵称,即可参与社区互动!

确定
我再想想
选择版块

way

发帖: 24粉丝: 4

级别 : 版主

Rank: 7Rank: 7Rank: 7

发消息 + 关注

发表于2020-2-12 19:48:21 801 2 楼主 显示全部楼层
[迁移工具] 【porting-advisor工具问题反馈】 工具错误的分析依赖


1. porting-advisor 软件构建中心重构如下版本kafka

http://s3.amazonaws.com/dev.hortonworks.com/HDP/centos7/3.x/BUILDS/3.1.0.0-78/kafka/kafka_3_1_0_0_78-2.0.0.3.1.0.0-78.noarch.rpm


2. 用手动checkSo检查,只有rocksdbjni-5.7.3.jar需要重新版本,但工具反馈有如下3个jar要编译和下载

[root@centos-164 logs]# cat /opt/portadv/portadmin/rpms/kafka_3_1_0_0_78.txt

Please download or compile these files and place them in the tool data directory(/opt/portadv/data/)

snappy-java-1.1.7.1.jar, /usr/hdp/3.1.0.0-78/kafka/libs/snappy-java-1.1.7.1.jar,

lz4-java-1.4.1.jar, /usr/hdp/3.1.0.0-78/kafka/libs/lz4-java-1.4.1.jar,

rocksdbjni-5.7.3.jar, /usr/hdp/3.1.0.0-78/kafka/libs/rocksdbjni-5.7.3.jar,

https://repo.huaweicloud.com/repository/maven/kunpeng/org/rocksdb/rocksdbjni/5.7.3/rocksdbjni-5.7.3.jar




[Wed, 12 Feb 2020 19:33:02] [ERROR] [refactoring:analysis_package:333] [['hdp-select', '', '', '', 'centos', '7.6', '5', ''], ['zookeeper_3_1_0_0_78', '', '', '', 'centos', '7.6', '5', ''], ['coreutils', '', '', '', 'centos', '7.6', '5', ''], ['ranger_3_1_0_0_78-kafka-plugin', '', '', '', 'centos', '7.6', '5', ''], ['snappy-java-1.1.7.1.jar', '', '/kafka_3_1_0_0_78-2.0.0.3.1.0.0-78.noarch.rpm/usr/hdp/3.1.0.0-78/kafka/libs/snappy-java-1.1.7.1.jar', 'centos', '7.6', '5', ''], ['lz4-java-1.4.1.jar', '', '/kafka_3_1_0_0_78-2.0.0.3.1.0.0-78.noarch.rpm/usr/hdp/3.1.0.0-78/kafka/libs/lz4-java-1.4.1.jar', 'centos', '7.6', '5', ''], ['rocksdbjni-5.7.3.jar', '', '/kafka_3_1_0_0_78-2.0.0.3.1.0.0-78.noarch.rpm/usr/hdp/3.1.0.0-78/kafka/libs/rocksdbjni-5.7.3.jar', 'centos', '7.6', '6', 'https://repo.huaweicloud.com/repository/maven/kunpeng/org/rocksdb/rocksdbjni/5.7.3/rocksdbjni-5.7.3.jar'], [7, 0, 0, 0, 0, 0, 6, 1]]

[Wed, 12 Feb 2020 19:33:02] [ERROR] [refactoring:analysis_package:352] 'int' object has no attribute 'split'

[Wed, 12 Feb 2020 19:33:02] [DEBUG] [refactoring:analysis_package:355] 7 this is a dependent so file

[Wed, 12 Feb 2020 19:33:02] [INFO] [refactoring:analysis_package:360] [['snappy-java-1.1.7.1.jar', '/usr/hdp/3.1.0.0-78/kafka/libs/snappy-java-1.1.7.1.jar', ''], ['lz4-java-1.4.1.jar', '/usr/hdp/3.1.0.0-78/kafka/libs/lz4-java-1.4.1.jar', ''], ['rocksdbjni-5.7.3.jar', '/usr/hdp/3.1.0.0-78/kafka/libs/rocksdbjni-5.7.3.jar', 'https://repo.huaweicloud.com/repository/maven/kunpeng/org/rocksdb/rocksdbjni/5.7.3/rocksdbjni-5.7.3.jar']]

[Wed, 12 Feb 2020 19:33:02] [DEBUG] [refactoring:check_data:275] check data directory

[Wed, 12 Feb 2020 19:33:02] [INFO] [refactoring:check_data:276] <tool.refactoring.refactoring.Refactor object at 0xffff9736db38>

[Wed, 12 Feb 2020 19:33:02] [INFO] [refactoring:check_data:286] data path files: ['wordcount-nopipe', 'container-executor', 'libhadoop.so.1.0.0', 'libhdfs.so.0.0.0', 'test-container-executor', 'libnativetask.so.1.0.0', 'pipes-sort', 'wordcount-simple', 'wordcount-part', 'libsnappy.so.1.1.4', 'wildfly-openssl-1.0.4.Final.jar', 'leveldbjni-all-1.8.jar', 'snappy-java-1.0.5.jar', 'hbase-shaded-netty-2.0.0.jar', 'commons-crypto-1.0.0.jar', 'lz4-1.2.0.jar', 'netty-all-4.0.52.Final.jar', 'hadoop-client-runtime-3.1.1.3.1.0.0-78.jar', 'hadoop-client-minicluster-3.1.1.3.1.0.0-78.jar']

[Wed, 12 Feb 2020 19:33:02] [INFO] [refactoring:check_data:290] ['snappy-java-1.1.7.1.jar', '/usr/hdp/3.1.0.0-78/kafka/libs/snappy-java-1.1.7.1.jar', '']

[Wed, 12 Feb 2020 19:33:02] [INFO] [refactoring:check_data:290] ['lz4-java-1.4.1.jar', '/usr/hdp/3.1.0.0-78/kafka/libs/lz4-java-1.4.1.jar', '']

[Wed, 12 Feb 2020 19:33:02] [INFO] [refactoring:check_data:290] ['rocksdbjni-5.7.3.jar', '/usr/hdp/3.1.0.0-78/kafka/libs/rocksdbjni-5.7.3.jar', 'https://repo.huaweicloud.com/repository/maven/kunpeng/org/rocksdb/rocksdbjni/5.7.3/rocksdbjni-5.7.3.jar']

[Wed, 12 Feb 2020 19:33:02] [INFO] [refactoring:check_data:300] user need download or compile: set()

[Wed, 12 Feb 2020 19:33:02] [DEBUG] [refactoring:download_files:604] download jar file

[Wed, 12 Feb 2020 19:33:02] [INFO] [refactoring:download_from_remote:367] <tool.refactoring.refactoring.Refactor object at 0xffff9736db38>

[Wed, 12 Feb 2020 19:33:02] [DEBUG] [refactoring:download_from_remote:368] download from remote

[Wed, 12 Feb 2020 19:33:02] [ERROR] [refactoring:download_from_remote:379] download jar file failed

[Wed, 12 Feb 2020 19:33:02] [ERROR] [refactoring:download_from_remote:380] unknown url type: ''

[Wed, 12 Feb 2020 19:33:02] [INFO] [refactoring:download_from_remote:367] <tool.refactoring.refactoring.Refactor object at 0xffff9736db38>

[Wed, 12 Feb 2020 19:33:02] [DEBUG] [refactoring:download_from_remote:368] download from remote

[Wed, 12 Feb 2020 19:33:02] [ERROR] [refactoring:download_from_remote:379] download jar file failed

[Wed, 12 Feb 2020 19:33:02] [ERROR] [refactoring:download_from_remote:380] unknown url type: ''

[Wed, 12 Feb 2020 19:33:02] [INFO] [refactoring:download_from_remote:367] <tool.refactoring.refactoring.Refactor object at 0xffff9736db38>

[Wed, 12 Feb 2020 19:33:02] [DEBUG] [refactoring:download_from_remote:368] download from remote

[Wed, 12 Feb 2020 19:33:04] [DEBUG] [refactoring_status_api:get_refactoring_status:35] get refactor status

[Wed, 12 Feb 2020 19:33:04] [DEBUG] [views:getstatus:104] check repackage status

[Wed, 12 Feb 2020 19:33:07] [DEBUG] [refactoring_status_api:get_refactoring_status:35] get refactor status

[Wed, 12 Feb 2020 19:33:07] [DEBUG] [views:getstatus:104] check repackage status

[Wed, 12 Feb 2020 19:33:10] [DEBUG] [refactoring_status_api:get_refactoring_status:35] get refactor status

[Wed, 12 Feb 2020 19:33:10] [DEBUG] [views:getstatus:104] check repackage status

[Wed, 12 Feb 2020 19:33:13] [DEBUG] [refactoring_status_api:get_refactoring_status:35] get refactor status

[Wed, 12 Feb 2020 19:33:13] [DEBUG] [views:getstatus:104] check repackage status

[Wed, 12 Feb 2020 19:33:16] [DEBUG] [refactoring_status_api:get_refactoring_status:35] get refactor status

[Wed, 12 Feb 2020 19:33:16] [DEBUG] [views:getstatus:104] check repackage status

[Wed, 12 Feb 2020 19:33:17] [ERROR] [refactoring:download_from_remote:379] download jar file failed

[Wed, 12 Feb 2020 19:33:17] [ERROR] [refactoring:download_from_remote:380] <urlopen error timed out>

[Wed, 12 Feb 2020 19:33:17] [ERROR] [refactoring:start:712] Missing corresponding jar file

[Wed, 12 Feb 2020 19:33:17] [DEBUG] [refactoring:result_write_to_file:621] Packaging failed with results written to file

[Wed, 12 Feb 2020 19:33:17] [DEBUG] [refactoring:result_write_to_file:628] /opt/portadv/portadmin/rpms/kafka_3_1_0_0_78.txt

[Wed, 12 Feb 2020 19:33:17] [INFO] [refactoring_api:start_autopack:65]

     Auto package api


[Wed, 12 Feb 2020 19:33:20] [DEBUG] [refactoring_status_api:get_refactoring_status:35] get refactor status

[Wed, 12 Feb 2020 19:33:20] [DEBUG] [views:getstatus:104] check repackage status



举报
分享

分享文章到朋友圈

分享文章到微博

阿奇@汪汪...

发帖: 26粉丝: 10

级别 : 版主

Rank: 7Rank: 7Rank: 7

发消息 + 关注

发表于2020-2-12 20:48:24 沙发 显示全部楼层

收到问题,已转给后台处理。多谢

点赞 评论 引用 举报

东方太阳

发帖: 0粉丝: 0

级别 : 新手上路

Rank: 1

发消息 + 关注

发表于2020-2-13 20:33:23 板凳 显示全部楼层

我们对jar包的处理逻辑是jar包中有非aarch64的so,.a文件或者可执行文件就会将jar包显示出来,多出来的那两个jar包经手动验证的确符合工具扫描的要求,不知道你这边的check_so的扫描标准是什么呢?

评论
way 2020-2-14 10:41 评论

多出来的2个jar包里包含了不同架构的同名so,请参照checkso的逻辑,只要同名so有aarch64架构,就认同此jar不需要重新编译。

... 查看全部
点赞 评论 引用 举报

游客

富文本
Markdown
您需要登录后才可以回帖 登录 | 立即注册