华为云云原生训练营学习（二）在鲲鹏的k8s部署NFS

    学习k8s存储架构原理后，对持久化存储和PV/PVC的工作原理有了更深入的了解。部署cephfs条件需要3个以上的node节点和每个节点都必须有3个以上的硬盘才可以。如果部署要另外添加云硬盘，增加学习成本，不划算。之前有部署过glusterfs，但是怕部署glusterfs会跟华为的MRS大数据集群在同时使用时有冲突和抢占资源（特别是存储资源），所以我部署了NFS作为共享存储，避免资源的抢占。

    1.1 在mas2安装NFS软件和启动NFS：

yum -y install nfs-utils rpcbind

systemctl start nfs-server rpcbind    

systemctl enable nfs-server rpcbind

查看硬盘容量:

df -h

    1.2 建立NFS目录

mkdir -p /srv/BigData/k8snfs

cd /srv/BigData/k8snfs

echo wuyicom > index.html

    1.3  修改配置

vi /etc/exports

/srv/BigData/k8snfs *(rw,async,no_root_squash)

    1.4 重启NFS

systemctl restart nfs-server

exportfs -arv

    1.5 客户端测试，所有node节点上要安装nfs客户端

yum -y install nfs-utils rpcbind

systemctl start nfs rpcbind

showmount -e 192.168.0.146

    2.手动管理pv和pvc太麻烦了，建议使用StorageClass管理pv和pvc

动态生成pv需要StorageClass和nfs-client-provisioner的共同作用

    2.1 创建nfs-client-provisioner

provisione直接使用nfs服务器

查看是否有nfs-client-provisioner镜像

docker search nfs-client-provisioner

docker pull jmgao1983/nfs-client-provisioner

    2.2 创建deployment.yaml文件

****

vi deployment.yaml

kind: Deployment

apiVersion: apps/v1

metadata:

  name: nfs-client-provisioner

spec:

  replicas: 1

  selector:

    matchLabels:

      app: nfs-client-provisioner

  strategy:

    type: Recreate

  template:

    metadata:

      labels:

        app: nfs-client-provisioner

    spec:

      serviceAccountName: nfs-client-provisioner

      containers:

        - name: nfs-client-provisioner

          image: jmgao1983/nfs-client-provisioner:latest

          volumeMounts:

            - name: nfs-client-root

              mountPath: /persistentvolumes

          env:

            - name: PROVISIONER_NAME

              value: fuseim.pri/ifs

            - name: NFS_SERVER

              value: 192.168.0.146

            - name: NFS_PATH

              value: /srv/BigData/k8snfs

      volumes:

        - name: nfs-client-root

          nfs:

            server: 192.168.0.146

            path: /srv/BigData/k8snfs

---

apiVersion: v1

kind: ServiceAccount

metadata:

  name: nfs-client-provisioner

---

kind: ClusterRole

apiVersion: rbac.authorization.k8s.io/v1

metadata:

  name: nfs-client-provisioner-runner

rules:

  - apiGroups: [""]

    resources: ["persistentvolumes"]

    verbs: ["get", "list", "watch", "create", "delete"]

  - apiGroups: [""]

    resources: ["persistentvolumeclaims"]

    verbs: ["get", "list", "watch", "update"]

  - apiGroups: ["storage.k8s.io"]

    resources: ["storageclasses"]

    verbs: ["get", "list", "watch"]

  - apiGroups: [""]

    resources: ["events"]

    verbs: ["list", "watch", "create", "update", "patch"]

  - apiGroups: [""]

    resources: ["endpoints"]

    verbs: ["create", "delete", "get", "list", "watch", "patch", "update"]

---

kind: ClusterRoleBinding

apiVersion: rbac.authorization.k8s.io/v1

metadata:

  name: run-nfs-client-provisioner

subjects:

  - kind: ServiceAccount

    name: nfs-client-provisioner

    namespace: default

roleRef:

  kind: ClusterRole

  name: nfs-client-provisioner-runner

  apiGroup: rbac.authorization.k8s.io

*************

kubectl create -f deployment.yaml

查看POD：

kubectl get pod

    2.3 创建StorageClass

vi nfsclass.yaml

apiVersion: storage.k8s.io/v1

kind: StorageClass

metadata:

  name: course-nfs-storage

provisioner: fuseim.pri/ifs

**************

kubectl create -f nfsclass.yaml

查看storageclass:

kubectl get sc

    2.4 在做测试：

vi test2.yaml

apiVersion: apps/v1

kind: StatefulSet

metadata:

  name: nfs-web

spec:

  serviceName: "nginx"

  replicas: 2

  selector:

    matchLabels:

      app: nfs-web

  template:

    metadata:

      labels:

        app: nfs-web

    spec:

      terminationGracePeriodSeconds: 10

      containers:

      - name: nginx

        image: nginx

        ports:

        - containerPort: 80

          name: web

        volumeMounts:

        - name: www

          mountPath: /usr/share/nginx/html

  volumeClaimTemplates:

  - metadata:

      name: www

      annotations:

        volume.beta.kubernetes.io/storage-class: course-nfs-storage

    spec:

      accessModes: [ "ReadWriteOnce" ]

      resources:

        requests:

          storage: 1Gi

*********************

kubectl create -f test-pod.yaml

出现下面的问题如图所示：

出现这个问题后后续再解决吧。