Hadoop hdfs客户端配置

hdfs单节点安装配置参考：

https://bbs.huaweicloud.com/blogs/315874

新建用户tdsql,并解压hadoop软件：

#地址修改hdfs 的地址。

修改配置文件：（core-site.xml）

<configuration>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://192.168.5.200:9000</value>
    </property>
</configuration>

#测试是否可以正常访问

查看目录：

[tdsql@db02 hadoop-3.3.0]$ ./bin/hdfs dfs -ls /
Found 1 items
drwxrwxrwx   - hadoop supergroup          0 2021-12-14 11:13 /test

#上传文件测试

[hadoop@db01 hadoop-3.3.0]$ ./bin/hdfs dfs -mkdir /tdsql
[hadoop@db01 hadoop-3.3.0]$ ./bin/hdfs dfs -chown tdsql:tdsql /tdsql
[hadoop@db01 hadoop-3.3.0]$ ./bin/hdfs dfs -ls /
##上次文件
[tdsql@db02 hadoop-3.3.0]$ ./bin/hdfs dfs -ls /tdsql
[tdsql@db02 hadoop-3.3.0]$ ./bin/hdfs dfs -put README.txt /tdsql
[tdsql@db02 hadoop-3.3.0]$ ./bin/hdfs dfs -ls /tdsql
Found 1 items
-rw-r--r--   3 tdsql tdsql        175 2021-12-14 11:20 /tdsql/README.txt

手动指定fs地址：

-fs <file:///|hdfs://namenode:port> specify default filesystem URL to use, overrides 'fs.defaultFS' property from configurations.

[tdsql@db02 hadoop-3.3.0]$  ./bin/hdfs dfs -fs hdfs://192.168.5.200:9000 -ls /
Found 2 items
drwxr-xr-x   - tdsql  tdsql               0 2021-12-14 11:20 /tdsql
drwxrwxrwx   - hadoop supergroup          0 2021-12-14 11:13 /test