Casm 5740 fm ha #6405

ravikanth-nalla-hpe · 2025-11-24T05:14:10Z

Description

Checklist

If I added any command snippets, the steps they belong to follow the prompt conventions (see example).
If I added a new directory, I also updated .github/CODEOWNERS with the corresponding team in Cray-HPE.
My commits or Pull-Request Title contain my JIRA information, or I do not have a JIRA.

- initial place holder for FM on baremetal docs

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

…n_Baremetal.md Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

sravani-sanigepalli · 2025-11-25T11:02:36Z

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md

+## Note:
+
+* Fabric Manager Nodes (`FMNs`) can be added only after the CSM upgrade has been completed.
+* By default, Fabric Manager on baremetal is disabled.


This can be rephrased to something like -
By default, Fabric Manager would be running on kubernetes as a pod

sravani-sanigepalli · 2025-11-25T11:12:41Z

NCN add procedure document needs to be referenced from the top level document and modified to support Fabric Manager also -
NCN add procedure

Things to note -
The above procedure also covers booting the nodes, adding switch configuration, updating firmware. These sections would need to reviewed and confirmed if they can be referenced from here directly instead of creating new sections in the main document. Its better to do it this way, since the current add procedure already have the complete flow setup.

Boot -

Boot NCN

Add switch configuration -

Add Switch Config

Update firmware -

Update Firmware

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

sravani-sanigepalli · 2025-12-04T07:54:08Z

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md

+
+* Validate SHCD with respect to FMNs
+* Map FMNs in the SHCD to the node type: `Management_FabricManager` when building the CCJ file
+* Generate switch configuration for the node based on the new Role: `Management` , SubRole: `FabricManager` pairing


Generating switch configuration does not happen at this stage. This step also needs to be removed

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md

sravani-sanigepalli · 2025-12-04T08:21:05Z

operations/fm_on_baremetal/README.md

+[Slingshot Host Software](../../glossary.md#slingshot-host-software-shs)
+
+### FM
+[Fabric Manager](...)


Glossary needs to be updated with description and linked here. That might be the part of next step, just adding a comment to not overlook. Same for FMN also

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

sravani-sanigepalli · 2025-12-08T06:43:16Z

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md

+
+Verify that the BMC of each FMN is configured with the correct root user credentials.
+
+### Perform CANU validation


CANU validation will be covered as part of Add Procedure. So this section could be removed

sravani-sanigepalli · 2025-12-08T06:44:09Z

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md

+
+After creating the FMN base image, add FMN nodes to CSM by following the [NCN add procedure](../../operations/node_management/Add_Remove_Replace_NCNs/Add_Remove_Replace_NCNs.md)
+
+**Note:** 


This note can be removed now since they are modified in the Add Procedure

sravani-sanigepalli · 2025-12-08T06:44:39Z

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md

+
+After completion of the NCN add procedure, SLS, HSM, and BSS will contain the corresponding FMN data. 
+
+The following checks can be used to verify that the updates have been correctly applied:


These steps can be moved to final validation section

sravani-sanigepalli · 2025-12-08T06:45:34Z

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md

+cray bss bootparameters list --hosts Global --format json
+```
+
+### Update Switch Configuration With CANU


Updating Switch Configuration is also handled as part of Add Procedure. Should be removed from here

sravani-sanigepalli · 2025-12-08T06:46:06Z

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md

+Take extreme care when manipulating ACLs, if CANU suggests moving a "permit any ..." rule be sure to create the new rule before removing the old one. It is possible to lose access to the switch if the ACLs are not applied in the correct order.
+
+
+## FMN Booting


Node Booting is also present as part of Add Procedure. Needs to be removed from here

sravani-sanigepalli · 2025-12-08T06:47:27Z

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md

+Check NMN, CMN, HMN, CHN, metal and virtual IP configuration for both FMN nodes (`fmn001` and `fmn002`).
+
+```bash
+ncn-m001:~/sav/csm-config # cray sls networks list


Suggested change

ncn-m001:~/sav/csm-config # cray sls networks list

ncn-m001:~ # cray sls networks list

sravani-sanigepalli · 2025-12-08T06:48:49Z

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md

+
+For install/ upgrade Fabric Manager on the FMNs please refer [FabricManager Install/ Upgrade](...)
+
+## Uninstall FMN Helm Chart


This section could be removed from CSM documentation. It makes sense for Slingshot team to handle it

sravani-sanigepalli · 2025-12-08T06:50:09Z

operations/fm_on_baremetal/README.md

+
+## Introduction
+
+The Fabric Manager (FM) bare-metal enablement within the Cray System Management (CSM) framework introduces dedicated Fabric Manager Nodes (FMNs) that manage and monitor Slingshot fabric operations outside of a Kubernetes environment. While the overall bare-metal Fabric Manager solution is described in the Slingshot Fabric Manager HA documentation <reference>, this CSM detail design document focuses specifically on the CSM-level enhancements required to integrate and support FMNs.


Last line could be modified. This is not a CSM detail design document.

sravani-sanigepalli · 2025-12-08T06:51:59Z

operations/node_management/Add_Remove_Replace_NCNs/Add_NCN_Data.md

            --mac-lan1 b8:59:9f:d9:9d:e9
        ```

+    * Optional: For FMNs (Fabric Manager Nodes), we need to pass on `--fmn-image-id` parameter with FMN base image ID generated in the [FMN base image creation stage]


Suggested change

* Optional: For FMNs (Fabric Manager Nodes), we need to pass on `--fmn-image-id` parameter with FMN base image ID generated in the [FMN base image creation stage]

* Optional: For FMNs (Fabric Manager Nodes) where alias is fmn00*, we need to pass additional `--fmn-image-id` parameter with FMN base image ID generated in the [FMN base image creation stage]

sravani-sanigepalli · 2025-12-08T06:52:39Z

operations/node_management/Add_Remove_Replace_NCNs/Add_NCN_Data.md

        ```

+    * Optional: For FMNs (Fabric Manager Nodes), we need to pass on `--fmn-image-id` parameter with FMN base image ID generated in the [FMN base image creation stage]
+      (https://github.com/Cray-HPE/docs-csm/blob/CASM-5740-fm-ha/operations/fm_on_baremetal/Configure_FM_On_Baremetal.md#fmn-base-image-creation).


The link is not displayed properly

sravani-sanigepalli · 2025-12-08T06:53:10Z

operations/node_management/Add_Remove_Replace_NCNs/Add_NCN_Data.md

+        For Example: Base image id of FMN is `06135c73-bcd9-4d38-928f-ada20bdf6a6`
+      
+        ```bash
+            cd /usr/share/doc/csm/scripts/operations/node_management/Add_Remove_Replace_NCNs/


--fmn-image-id parameter needs to be added for this command also.

sravani-sanigepalli · 2025-12-08T06:54:04Z

operations/node_management/Add_Remove_Replace_NCNs/Add_Remove_Replace_NCNs.md

   ```

-## Add worker, storage, or master NCNs
+2. Optional: For adding FMNs (Fabric Manager Nodes) to CSM there is a new prompt added to confirm if the node getting added is an FMN or not:


This is not an optional prompt. This should be clubbed with above prompt only

sravani-sanigepalli · 2025-12-08T06:55:13Z

operations/node_management/Add_Remove_Replace_NCNs/Add_Remove_Replace_NCNs.md

-Use this procedure to add a worker, storage, or master NCN.
+   Existing prompt to add number of NCN nodes:
+
+   ```text


There can be two examples provided - one with FMN prompt with no (existing case) and another with FMN prompt with yes (showing FMN details along with fmn-vips)

sravani-sanigepalli · 2025-12-08T07:01:15Z

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md

+
+### Add FMN Nodes to CSM
+
+After creating the FMN base image, add FMN nodes to CSM by following the [NCN add procedure](../../operations/node_management/Add_Remove_Replace_NCNs/Add_Remove_Replace_NCNs.md)


This should point to specific add section instead of top level document which actually handles Add, Remove and Replace procedures.
https://github.com/Cray-HPE/docs-csm/blob/CASM-5740-fm-ha/operations/node_management/Add_Remove_Replace_NCNs/Add_Remove_Replace_NCNs.md#add-worker-storage-master-or-fmnfabric-manager-node-ncns

sravani-sanigepalli · 2025-12-08T07:03:49Z

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md

+
+### Add FMN Nodes to CSM
+
+After creating the FMN base image, add FMN nodes to CSM by following the [NCN add procedure](../../operations/node_management/Add_Remove_Replace_NCNs/Add_Remove_Replace_NCNs.md)


We can explicitly mention to follow step 1 to step 6 of Add Procedure.
Also, a note could be added at the end of https://github.com/Cray-HPE/docs-csm/blob/CASM-5740-fm-ha/operations/node_management/Add_Remove_Replace_NCNs/Boot_NCN.md
to skip the next steps for FMN

sravani-sanigepalli · 2025-12-08T07:07:28Z

operations/fm_on_baremetal/README.md

+**NOTE**:
+
+* `FMNs` are considered Management nodes.
+* FM cannot be disabled after it has been enabled.


This can be removed completely as explicit mentioning would not be needed (or) rephrased to -
After Fabric Manager is migrated from a Kubernetes pod to bare-metal infrastructure, it cannot be reverted.

sravani-sanigepalli · 2025-12-08T07:12:17Z

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md

+
+* Fabric Manager Nodes (`FMNs`) can be added only after the CSM upgrade has been completed.
+* By default, Fabric Manager on baremetal is disabled.
+* Once enabled, Fabric Manager on baremetal cannot be disabled.


This could either be removed as mentioning explicitly is not needed (or) rephrased to -
After Fabric Manager is migrated from a Kubernetes pod to bare-metal infrastructure, it cannot be reverted.

ravikanth-nalla-hpe and others added 25 commits November 14, 2025 10:38

CASM-5740: [FM on baremetal] Documentation for FM migration to baremetal

f605711

- initial place holder for FM on baremetal docs

Update README.md

514f799

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Create Enabling_FM_On_Baremetal_Post_CSM_Upgrade.md

a89a9b1

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Enabling_FM_On_Baremetal_Post_CSM_Upgrade.md

e8e9cee

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Enabling_FM_On_Baremetal_Post_CSM_Upgrade.md

b8291a5

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Enabling_FM_On_Baremetal_Post_CSM_Upgrade.md

30d837b

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

0d37369

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

f748d2c

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

a054126

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Enabling_FM_On_Baremetal_Post_CSM_Upgrade.md

5319af7

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

1f24eca

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

05aaa89

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

df6d564

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

c1d0426

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Enabling_FM_On_Baremetal_Post_CSM_Upgrade.md

1da2622

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

7a69265

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

b07e474

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Enabling_FM_On_Baremetal_Post_CSM_Upgrade.md

47db18d

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

37d8d93

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

4aa819e

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Rename Enabling_FM_On_Baremetal_Post_CSM_Upgrade.md to Configure_FM_O…

e3a13ea

…n_Baremetal.md Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Configure_FM_On_Baremetal.md

c27fd16

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

c2dc283

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Add files via upload

2642d23

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

1474525

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

ravikanth-nalla-hpe requested review from rajeshranganathan-hpe and sravani-sanigepalli November 25, 2025 08:50

sravani-sanigepalli reviewed Nov 25, 2025

View reviewed changes

Update README.md

fd57028

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

sravani-sanigepalli reviewed Dec 4, 2025

View reviewed changes

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md Outdated Show resolved Hide resolved

sravani-sanigepalli reviewed Dec 4, 2025

View reviewed changes

operations/fm_on_baremetal/Configure_FM_On_Baremetal.md Outdated Show resolved Hide resolved

sravani-sanigepalli reviewed Dec 4, 2025

View reviewed changes

ravikanth-nalla-hpe added 9 commits December 4, 2025 16:01

Update Configure_FM_On_Baremetal.md

5c41dd5

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Configure_FM_On_Baremetal.md

34ad621

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Add_NCN_Data.md

3d92f81

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Configure_FM_On_Baremetal.md

67fc5fe

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Configure_FM_On_Baremetal.md

eec4e42

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Configure_FM_On_Baremetal.md

9292373

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update README.md

cd7778d

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Configure_FM_On_Baremetal.md

eaab7fc

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

Update Configure_FM_On_Baremetal.md

22abe76

Signed-off-by: ravikanth-nalla-hpe <140072234+ravikanth-nalla-hpe@users.noreply.github.com>

sravani-sanigepalli reviewed Dec 8, 2025

View reviewed changes


		Verify that the BMC of each FMN is configured with the correct root user credentials.

		### Perform CANU validation


		After creating the FMN base image, add FMN nodes to CSM by following the [NCN add procedure](../../operations/node_management/Add_Remove_Replace_NCNs/Add_Remove_Replace_NCNs.md)

		Note:


		After completion of the NCN add procedure, SLS, HSM, and BSS will contain the corresponding FMN data.

		The following checks can be used to verify that the updates have been correctly applied:

		Take extreme care when manipulating ACLs, if CANU suggests moving a "permit any ..." rule be sure to create the new rule before removing the old one. It is possible to lose access to the switch if the ACLs are not applied in the correct order.


		## FMN Booting

	ncn-m001:~/sav/csm-config # cray sls networks list
	ncn-m001:~ # cray sls networks list


		For install/ upgrade Fabric Manager on the FMNs please refer [FabricManager Install/ Upgrade](...)

		## Uninstall FMN Helm Chart


		## Introduction

		The Fabric Manager (FM) bare-metal enablement within the Cray System Management (CSM) framework introduces dedicated Fabric Manager Nodes (FMNs) that manage and monitor Slingshot fabric operations outside of a Kubernetes environment. While the overall bare-metal Fabric Manager solution is described in the Slingshot Fabric Manager HA documentation <reference>, this CSM detail design document focuses specifically on the CSM-level enhancements required to integrate and support FMNs.

	* Optional: For FMNs (Fabric Manager Nodes), we need to pass on `--fmn-image-id` parameter with FMN base image ID generated in the [FMN base image creation stage]
	* Optional: For FMNs (Fabric Manager Nodes) where alias is fmn00*, we need to pass additional `--fmn-image-id` parameter with FMN base image ID generated in the [FMN base image creation stage]


		### Add FMN Nodes to CSM

		After creating the FMN base image, add FMN nodes to CSM by following the [NCN add procedure](../../operations/node_management/Add_Remove_Replace_NCNs/Add_Remove_Replace_NCNs.md)

Casm 5740 fm ha #6405

Are you sure you want to change the base?

Casm 5740 fm ha #6405

Conversation

ravikanth-nalla-hpe commented Nov 24, 2025

Description

Checklist

Uh oh!

sravani-sanigepalli Nov 25, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

sravani-sanigepalli commented Nov 25, 2025

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

sravani-sanigepalli Dec 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

sravani-sanigepalli Dec 8, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

sravani-sanigepalli Nov 25, 2025 •

edited

Loading

sravani-sanigepalli Dec 8, 2025 •

edited

Loading

sravani-sanigepalli Dec 8, 2025 •

edited

Loading