[Bug] multiple RAID arrays combined into one volume

[jubbens]

Description of the bug

I have a RAID 0 array of two drives, and a RAID 1 array of two drives. They show up as a single storage volume.

The size listed is the size of the RAID 1 array and all four drives are listed under it.

I also have the 0% bug on this volume #292

How to reproduce

No response

Relevant log output

No response

Info output of dashdot cli

yarn run v1.22.19
$ node dist/apps/cli/main.js info
INFO
=========
Yarn: 1.22.19
Node: v18.7.0
Dash: 4.3.10

Cwd: /app
Hash: 3caa68f5ee9bfdf14dadcd5c5a0358aadadff90b
In Docker: true
In Podman: false
In Docker (env): true
Done in 0.47s.

What browsers are you seeing the problem on?

Chrome

Where is your instance running?

Linux Server

Additional context

Raw data

    yarn run v1.22.19
    $ node dist/apps/cli/main.js raw-data --storage
    Disk Layout: [
      {
        device: '/dev/sda',
        type: 'SSD',
        name: 'OCZ-VERTEX3     ',
        vendor: 'ATA',
        size: 90028302336,
        bytesPerSector: null,
        totalCylinders: null,
        totalHeads: null,
        totalSectors: null,
        totalTracks: null,
        tracksPerCylinder: null,
        sectorsPerTrack: null,
        firmwareRevision: '2.22',
        serialNum: '',
        interfaceType: 'SATA',
        smartStatus: 'unknown',
        temperature: null
      },
      {
        device: '/dev/sdb',
        type: 'HD',
        name: 'ST4000DM004-2CV1',
        vendor: 'Seagate',
        size: 4000787030016,
        bytesPerSector: null,
        totalCylinders: null,
        totalHeads: null,
        totalSectors: null,
        totalTracks: null,
        tracksPerCylinder: null,
        sectorsPerTrack: null,
        firmwareRevision: '0001',
        serialNum: '',
        interfaceType: 'SATA',
        smartStatus: 'unknown',
        temperature: null
      },
      {
        device: '/dev/sdc',
        type: 'HD',
        name: 'ST4000DM004-2CV1',
        vendor: 'Seagate',
        size: 4000787030016,
        bytesPerSector: null,
        totalCylinders: null,
        totalHeads: null,
        totalSectors: null,
        totalTracks: null,
        tracksPerCylinder: null,
        sectorsPerTrack: null,
        firmwareRevision: '0001',
        serialNum: '',
        interfaceType: 'SATA',
        smartStatus: 'unknown',
        temperature: null
      },
      {
        device: '/dev/sdd',
        type: 'SSD',
        name: 'ADATA SU800     ',
        vendor: 'ATA',
        size: 512110190592,
        bytesPerSector: null,
        totalCylinders: null,
        totalHeads: null,
        totalSectors: null,
        totalTracks: null,
        tracksPerCylinder: null,
        sectorsPerTrack: null,
        firmwareRevision: '1A',
        serialNum: '',
        interfaceType: 'SATA',
        smartStatus: 'unknown',
        temperature: null
      },
      {
        device: '/dev/sde',
        type: 'SSD',
        name: 'ADATA SU800     ',
        vendor: 'ATA',
        size: 512110190592,
        bytesPerSector: null,
        totalCylinders: null,
        totalHeads: null,
        totalSectors: null,
        totalTracks: null,
        tracksPerCylinder: null,
        sectorsPerTrack: null,
        firmwareRevision: '7ANR',
        serialNum: '',
        interfaceType: 'SATA',
        smartStatus: 'unknown',
        temperature: null
      },
      {
        device: '/dev/sdf',
        type: 'HD',
        name: 'DataTraveler 3.0',
        vendor: 'Kingston',
        size: 61991813632,
        bytesPerSector: null,
        totalCylinders: null,
        totalHeads: null,
        totalSectors: null,
        totalTracks: null,
        tracksPerCylinder: null,
        sectorsPerTrack: null,
        firmwareRevision: '0000',
        serialNum: '',
        interfaceType: 'USB',
        smartStatus: 'unknown',
        temperature: null
      }
    ]
    FS Size: [
      {
        fs: 'overlay',
        type: 'overlay',
        size: 71289790464,
        used: 12009525248,
        available: 55614865408,
        use: 17.76,
        mount: '/'
      },
      {
        fs: '/dev/sda1',
        type: 'ext4',
        size: 71289790464,
        used: 12009525248,
        available: 55614865408,
        use: 17.76,
        mount: '/mnt/host'
      },
      {
        fs: '/dev/md1',
        type: 'ext4',
        size: 1006691278848,
        used: 880640,
        available: 1006673620992,
        use: 0,
        mount: '/mnt/host/srv/dev-disk-by-uuid-c341fe26-6494-4e16-a530-4dc06e3c904f'
      },
      {
        fs: '/dev/sdf1',
        type: 'ext4',
        size: 60749164544,
        used: 3735523328,
        available: 56996864000,
        use: 6.15,
        mount: '/mnt/host/srv/dev-disk-by-uuid-2422de0a-b36f-45dc-8999-edc746fb7499'
      },
      {
        fs: '/dev/md0',
        type: 'ext4',
        size: 3936780869632,
        used: 1383350038528,
        available: 2553414053888,
        use: 35.14,
        mount: '/mnt/host/srv/dev-disk-by-label-Array'
      }
    ]
    Block Devices: [
      {
        name: 'sda',
        type: 'disk',
        fsType: '',
        mount: '',
        size: 90028302336,
        physical: 'SSD',
        uuid: '',
        label: '',
        model: 'OCZ-VERTEX3     ',
        serial: '',
        removable: false,
        protocol: 'sata',
        group: undefined
      },
      {
        name: 'sdb',
        type: 'disk',
        fsType: 'linux_raid_member',
        mount: '',
        size: 4000787030016,
        physical: 'HDD',
        uuid: '70112d0e-8e45-9502-d1af-2eaaa608f693',
        label: 'Joe:mirrored',
        model: 'ST4000DM004-2CV1',
        serial: '',
        removable: false,
        protocol: 'sata',
        group: undefined
      },
      {
        name: 'sdc',
        type: 'disk',
        fsType: 'linux_raid_member',
        mount: '',
        size: 4000787030016,
        physical: 'HDD',
        uuid: '70112d0e-8e45-9502-d1af-2eaaa608f693',
        label: 'Joe:mirrored',
        model: 'ST4000DM004-2CV1',
        serial: '',
        removable: false,
        protocol: 'sata',
        group: undefined
      },
      {
        name: 'sdd',
        type: 'disk',
        fsType: 'linux_raid_member',
        mount: '',
        size: 512110190592,
        physical: 'SSD',
        uuid: 'ff12ce61-fdd1-920f-fd01-6eb8c668b47a',
        label: 'Joe:1',
        model: 'ADATA SU800     ',
        serial: '',
        removable: false,
        protocol: 'sata',
        group: undefined
      },
      {
        name: 'sde',
        type: 'disk',
        fsType: 'linux_raid_member',
        mount: '',
        size: 512110190592,
        physical: 'SSD',
        uuid: 'ff12ce61-fdd1-920f-fd01-6eb8c668b47a',
        label: 'Joe:1',
        model: 'ADATA SU800     ',
        serial: '',
        removable: false,
        protocol: 'sata',
        group: undefined
      },
      {
        name: 'sdf',
        type: 'disk',
        fsType: '',
        mount: '',
        size: 61991813632,
        physical: 'HDD',
        uuid: '',
        label: '',
        model: 'DataTraveler 3.0',
        serial: '',
        removable: true,
        protocol: 'usb',
        group: undefined
      },
      {
        name: 'sda1',
        type: 'part',
        fsType: 'ext4',
        mount: '/mnt/host',
        size: 72972500992,
        physical: '',
        uuid: '5bcd72c3-1606-4997-9ee3-6f1f088d13ed',
        label: '',
        model: '',
        serial: '',
        removable: false,
        protocol: '',
        group: undefined
      },
      {
        name: 'sda2',
        type: 'part',
        fsType: '',
        mount: '',
        size: 1024,
        physical: '',
        uuid: '',
        label: '',
        model: '',
        serial: '',
        removable: false,
        protocol: '',
        group: undefined
      },
      {
        name: 'sda5',
        type: 'part',
        fsType: 'swap',
        mount: '[SWAP]',
        size: 17052991488,
        physical: '',
        uuid: '51a5ff2c-2222-4c39-9188-87fc1b6d20ee',
        label: '',
        model: '',
        serial: '',
        removable: false,
        protocol: '',
        group: undefined
      },
      {
        name: 'sdf1',
        type: 'part',
        fsType: 'ext4',
        mount: '/mnt/host/srv/dev-disk-by-uuid-2422de0a-b36f-45dc-8999-edc746fb7499',
        size: 61990748160,
        physical: '',
        uuid: '2422de0a-b36f-45dc-8999-edc746fb7499',
        label: 'kingston',
        model: '',
        serial: '',
        removable: true,
        protocol: '',
        group: undefined
      },
      {
        name: 'md1',
        type: 'raid0',
        fsType: 'ext4',
        mount: '/mnt/host/srv/dev-disk-by-uuid-c341fe26-6494-4e16-a530-4dc06e3c904f',
        size: 1023949144064,
        physical: '',
        uuid: 'c341fe26-6494-4e16-a530-4dc06e3c904f',
        label: '',
        model: '',
        serial: '',
        removable: false,
        protocol: '',
        group: undefined
      },
      {
        name: 'md0',
        type: 'raid1',
        fsType: 'ext4',
        mount: '/mnt/host/srv/dev-disk-by-label-Array',
        size: 4000652787712,
        physical: '',
        uuid: 'a144c5d0-11e0-4889-94ff-74748b02777d',
        label: 'Array',
        model: '',
        serial: '',
        removable: false,
        protocol: '',
        group: undefined
      }
    ]
    Done in 0.34s.
      ```
</details>

[MauriceNino]

Thank you for the issue and for providing all the necessary info. I will notify you when I find any errors.

[MauriceNino]

So I have finally found some time to fix some of the problems, but unfortunately I still couldn't fix everything.

• The drives are now grouped in two separate raid volumes
• The last single drive now shows correct values

But I still could not match the raids' sizes to the correct blocks.

To better understand what I mean, these two blocks are the raid blocks on your system:

{
  name: 'md1',
  type: 'raid0',
  fsType: 'ext4',
  mount:
    '/mnt/host/srv/dev-disk-by-uuid-c341fe26-6494-4e16-a530-4dc06e3c904f',
  size: 1023949144064,
  physical: '',
  uuid: 'c341fe26-6494-4e16-a530-4dc06e3c904f',
  label: '',
  model: '',
  serial: '',
  removable: false,
  protocol: '',
  group: undefined,
},
{
  name: 'md0',
  type: 'raid1',
  fsType: 'ext4',
  mount: '/mnt/host/srv/dev-disk-by-label-Array',
  size: 4000652787712,
  physical: '',
  uuid: 'a144c5d0-11e0-4889-94ff-74748b02777d',
  label: 'Array',
  model: '',
  serial: '',
  removable: false,
  protocol: '',
  group: undefined,
},

And these are the relevant disks:

{
  name: 'sdb',
  type: 'disk',
  fsType: 'linux_raid_member',
  mount: '',
  size: 4000787030016,
  physical: 'HDD',
  uuid: '70112d0e-8e45-9502-d1af-2eaaa608f693',
  label: 'Joe:mirrored',
  model: 'ST4000DM004-2CV1',
  serial: '',
  removable: false,
  protocol: 'sata',
  group: undefined,
},
{
  name: 'sdc',
  type: 'disk',
  fsType: 'linux_raid_member',
  mount: '',
  size: 4000787030016,
  physical: 'HDD',
  uuid: '70112d0e-8e45-9502-d1af-2eaaa608f693',
  label: 'Joe:mirrored',
  model: 'ST4000DM004-2CV1',
  serial: '',
  removable: false,
  protocol: 'sata',
  group: undefined,
},
{
  name: 'sdd',
  type: 'disk',
  fsType: 'linux_raid_member',
  mount: '',
  size: 512110190592,
  physical: 'SSD',
  uuid: 'ff12ce61-fdd1-920f-fd01-6eb8c668b47a',
  label: 'Joe:1',
  model: 'ADATA SU800     ',
  serial: '',
  removable: false,
  protocol: 'sata',
  group: undefined,
},
{
  name: 'sde',
  type: 'disk',
  fsType: 'linux_raid_member',
  mount: '',
  size: 512110190592,
  physical: 'SSD',
  uuid: 'ff12ce61-fdd1-920f-fd01-6eb8c668b47a',
  label: 'Joe:1',
  model: 'ADATA SU800     ',
  serial: '',
  removable: false,
  protocol: 'sata',
  group: undefined,
},

But I don't know how I would find out which raid belongs to which disk.

@sebhildebrandt are you maybe aware of a way to match those? Or could this be added to systeminformation?

[MauriceNino]

Hello @jubbens - could you by any chance please post the output of the following commands?

mdadm --export --detail /dev/md0
mdadm --export --detail /dev/md1

[jubbens]

@MauriceNino absolutely:

:~# mdadm --export --detail /dev/md0
MD_LEVEL=raid1
MD_DEVICES=2
MD_METADATA=1.2
MD_UUID=70112d0e:8e459502:d1af2eaa:a608f693
MD_NAME=Joe:mirrored
MD_DEVICE_ev_sdc_ROLE=1
MD_DEVICE_ev_sdc_DEV=/dev/sdc
MD_DEVICE_ev_sdb_ROLE=0
MD_DEVICE_ev_sdb_DEV=/dev/sdb

:~# mdadm --export --detail /dev/md1
MD_LEVEL=raid0
MD_DEVICES=2
MD_METADATA=1.2
MD_UUID=ff12ce61:fdd1920f:fd016eb8:c668b47a
MD_NAME=Joe:1
MD_DEVICE_ev_sde_ROLE=1
MD_DEVICE_ev_sde_DEV=/dev/sde
MD_DEVICE_ev_sdd_ROLE=0
MD_DEVICE_ev_sdd_DEV=/dev/sdd

[MauriceNino]

Thanks a lot!

[MauriceNino]

Hello again @jubbens - can you please update to the newest dev image (mauricenino/dashdot:dev) and send me the output of the following command:

docker exec CONTAINER yarn cli raw-data --storage

With that, I should be able to fully fix your issues.

[jubbens]

Here you go!

Output

yarn run v1.22.19
$ node dist/apps/cli/main.js raw-data --storage
Disk Layout: [
  {
    device: '/dev/sda',
    type: 'SSD',
    name: 'OCZ-VERTEX3     ',
    vendor: 'ATA',
    size: 90028302336,
    bytesPerSector: null,
    totalCylinders: null,
    totalHeads: null,
    totalSectors: null,
    totalTracks: null,
    tracksPerCylinder: null,
    sectorsPerTrack: null,
    firmwareRevision: '2.22',
    serialNum: '',
    interfaceType: 'SATA',
    smartStatus: 'unknown',
    temperature: null
  },
  {
    device: '/dev/sdb',
    type: 'HD',
    name: 'ST4000DM004-2CV1',
    vendor: 'Seagate',
    size: 4000787030016,
    bytesPerSector: null,
    totalCylinders: null,
    totalHeads: null,
    totalSectors: null,
    totalTracks: null,
    tracksPerCylinder: null,
    sectorsPerTrack: null,
    firmwareRevision: '0001',
    serialNum: '',
    interfaceType: 'SATA',
    smartStatus: 'unknown',
    temperature: null
  },
  {
    device: '/dev/sdc',
    type: 'HD',
    name: 'ST4000DM004-2CV1',
    vendor: 'Seagate',
    size: 4000787030016,
    bytesPerSector: null,
    totalCylinders: null,
    totalHeads: null,
    totalSectors: null,
    totalTracks: null,
    tracksPerCylinder: null,
    sectorsPerTrack: null,
    firmwareRevision: '0001',
    serialNum: '',
    interfaceType: 'SATA',
    smartStatus: 'unknown',
    temperature: null
  },
  {
    device: '/dev/sdd',
    type: 'SSD',
    name: 'ADATA SU800     ',
    vendor: 'ATA',
    size: 512110190592,
    bytesPerSector: null,
    totalCylinders: null,
    totalHeads: null,
    totalSectors: null,
    totalTracks: null,
    tracksPerCylinder: null,
    sectorsPerTrack: null,
    firmwareRevision: '1A',
    serialNum: '',
    interfaceType: 'SATA',
    smartStatus: 'unknown',
    temperature: null
  },
  {
    device: '/dev/sde',
    type: 'SSD',
    name: 'ADATA SU800     ',
    vendor: 'ATA',
    size: 512110190592,
    bytesPerSector: null,
    totalCylinders: null,
    totalHeads: null,
    totalSectors: null,
    totalTracks: null,
    tracksPerCylinder: null,
    sectorsPerTrack: null,
    firmwareRevision: '7ANR',
    serialNum: '',
    interfaceType: 'SATA',
    smartStatus: 'unknown',
    temperature: null
  },
  {
    device: '/dev/sdf',
    type: 'HD',
    name: 'DataTraveler 3.0',
    vendor: 'Kingston',
    size: 61991813632,
    bytesPerSector: null,
    totalCylinders: null,
    totalHeads: null,
    totalSectors: null,
    totalTracks: null,
    tracksPerCylinder: null,
    sectorsPerTrack: null,
    firmwareRevision: '0000',
    serialNum: '',
    interfaceType: 'USB',
    smartStatus: 'unknown',
    temperature: null
  }
]
FS Size: [
  {
    fs: 'overlay',
    type: 'overlay',
    size: 71289790464,
    used: 12283789312,
    available: 55340601344,
    use: 18.16,
    mount: '/'
  },
  {
    fs: '/dev/sda1',
    type: 'ext4',
    size: 71289790464,
    used: 12283789312,
    available: 55340601344,
    use: 18.16,
    mount: '/mnt/host'
  },
  {
    fs: '/dev/md1',
    type: 'ext4',
    size: 1006691278848,
    used: 4702208,
    available: 1006669799424,
    use: 0,
    mount: '/mnt/host/srv/dev-disk-by-uuid-c341fe26-6494-4e16-a530-4dc06e3c904f'
  },
  {
    fs: '/dev/sdf1',
    type: 'ext4',
    size: 60749164544,
    used: 3757428736,
    available: 56974958592,
    use: 6.19,
    mount: '/mnt/host/srv/dev-disk-by-uuid-2422de0a-b36f-45dc-8999-edc746fb7499'
  },
  {
    fs: '/dev/md0',
    type: 'ext4',
    size: 3936780869632,
    used: 1591186407424,
    available: 2345577684992,
    use: 40.42,
    mount: '/mnt/host/srv/dev-disk-by-label-Array'
  }
]
Block Devices: [
  {
    name: 'sda',
    type: 'disk',
    fsType: '',
    mount: '',
    size: 90028302336,
    physical: 'SSD',
    uuid: '',
    label: '',
    model: 'OCZ-VERTEX3     ',
    serial: '',
    removable: false,
    protocol: 'sata',
    group: undefined
  },
  {
    name: 'sdb',
    type: 'disk',
    fsType: 'linux_raid_member',
    mount: '',
    size: 4000787030016,
    physical: 'HDD',
    uuid: '70112d0e-8e45-9502-d1af-2eaaa608f693',
    label: 'Joe:mirrored',
    model: 'ST4000DM004-2CV1',
    serial: '',
    removable: false,
    protocol: 'sata',
    group: undefined
  },
  {
    name: 'sdc',
    type: 'disk',
    fsType: 'linux_raid_member',
    mount: '',
    size: 4000787030016,
    physical: 'HDD',
    uuid: '70112d0e-8e45-9502-d1af-2eaaa608f693',
    label: 'Joe:mirrored',
    model: 'ST4000DM004-2CV1',
    serial: '',
    removable: false,
    protocol: 'sata',
    group: undefined
  },
  {
    name: 'sdd',
    type: 'disk',
    fsType: 'linux_raid_member',
    mount: '',
    size: 512110190592,
    physical: 'SSD',
    uuid: 'ff12ce61-fdd1-920f-fd01-6eb8c668b47a',
    label: 'Joe:1',
    model: 'ADATA SU800     ',
    serial: '',
    removable: false,
    protocol: 'sata',
    group: undefined
  },
  {
    name: 'sde',
    type: 'disk',
    fsType: 'linux_raid_member',
    mount: '',
    size: 512110190592,
    physical: 'SSD',
    uuid: 'ff12ce61-fdd1-920f-fd01-6eb8c668b47a',
    label: 'Joe:1',
    model: 'ADATA SU800     ',
    serial: '',
    removable: false,
    protocol: 'sata',
    group: undefined
  },
  {
    name: 'sdf',
    type: 'disk',
    fsType: '',
    mount: '',
    size: 61991813632,
    physical: 'HDD',
    uuid: '',
    label: '',
    model: 'DataTraveler 3.0',
    serial: '',
    removable: true,
    protocol: 'usb',
    group: undefined
  },
  {
    name: 'sda1',
    type: 'part',
    fsType: 'ext4',
    mount: '/mnt/host',
    size: 72972500992,
    physical: '',
    uuid: '5bcd72c3-1606-4997-9ee3-6f1f088d13ed',
    label: '',
    model: '',
    serial: '',
    removable: false,
    protocol: '',
    group: undefined
  },
  {
    name: 'sda2',
    type: 'part',
    fsType: '',
    mount: '',
    size: 1024,
    physical: '',
    uuid: '',
    label: '',
    model: '',
    serial: '',
    removable: false,
    protocol: '',
    group: undefined
  },
  {
    name: 'sda5',
    type: 'part',
    fsType: 'swap',
    mount: '[SWAP]',
    size: 17052991488,
    physical: '',
    uuid: '51a5ff2c-2222-4c39-9188-87fc1b6d20ee',
    label: '',
    model: '',
    serial: '',
    removable: false,
    protocol: '',
    group: undefined
  },
  {
    name: 'sdf1',
    type: 'part',
    fsType: 'ext4',
    mount: '/mnt/host/srv/dev-disk-by-uuid-2422de0a-b36f-45dc-8999-edc746fb7499',
    size: 61990748160,
    physical: '',
    uuid: '2422de0a-b36f-45dc-8999-edc746fb7499',
    label: 'kingston',
    model: '',
    serial: '',
    removable: true,
    protocol: '',
    group: undefined
  },
  {
    name: 'md1',
    type: 'raid0',
    fsType: 'ext4',
    mount: '/mnt/host/srv/dev-disk-by-uuid-c341fe26-6494-4e16-a530-4dc06e3c904f',
    size: 1023949144064,
    physical: '',
    uuid: 'c341fe26-6494-4e16-a530-4dc06e3c904f',
    label: '',
    model: '',
    serial: '',
    removable: false,
    protocol: '',
    group: undefined
  },
  {
    name: 'md0',
    type: 'raid1',
    fsType: 'ext4',
    mount: '/mnt/host/srv/dev-disk-by-label-Array',
    size: 4000652787712,
    physical: '',
    uuid: 'a144c5d0-11e0-4889-94ff-74748b02777d',
    label: 'Array',
    model: '',
    serial: '',
    removable: false,
    protocol: '',
    group: undefined
  }
]

[MauriceNino]

@jubbens I am so sorry, I forgot to add the tool to the container (mdadm), therefore the output doesnt contain the new fields. I have updated the image now - could you please pull and send that output again?

[jubbens]

@MauriceNino I pulled the container at the latest tag but I still get the same output as before.

[sebhildebrandt]

@MauriceNino @jubbens Just an idea: maybe we should try the output of the underlying package first directly on the machine ... so if you can pull the systeminformation package and run it locally:

mkdir sysinfo
cd sysinfo
npm install systeminformation

and then have the following code disk.js:

const si = require('systeminformation');

const diskInformation = async () => {
	const resDL = await si.diskLayout();
	const resFS = await si.fsSize();
	const resBD = await si.blockDevices();

	console.log('Disk Layout');
	console.log(resDL);
	console.log('\n\nfsSize');
	console.log(resFS);
	console.log('\n\nBlock Defices');
	console.log(resBD);
}

diskInformation();

And then run node disk.js. Can you please also add once again the output of

mdadm --export --detail /dev/md0
mdadm --export --detail /dev/md1

Then we should see if the underlying package would spit out the correct output. Would that make sense?