Skip to content

HDFS data/metadata will lose when pod crash or restart. #14

Open
@baikai

Description

@baikai

I saw that hdfs nn/dn statefulset store hdfs data and metadata on container local dir(/root/hdfs/namenode, /root/hdfs/datanode) directly, not use k8s volume or persistvolume to persist hdfs data/metadata.
So that HDFS data/metadata will lose when pod crash or restart, we need find a way to persist data by leverage k8s storage tech, like pv/pvc.
.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions