diff --git a/docs/_pages/config-json.md b/docs/_pages/config-json.md
index e6ad26ca67fd..cdd18e62a29e 100755
--- a/docs/_pages/config-json.md
+++ b/docs/_pages/config-json.md
@@ -427,6 +427,12 @@ Enabling and configuring ZeRO memory optimizations
| ------------------------------------------------------------------------------------------------------------------- | ------- |
| Copies the gradients to a contiguous buffer as they are produced. Avoids memory fragmentation during backward pass. | `True` |
+**load_from_fp32_weights**: [boolean]
+
+| Description | Default |
+| ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | ------- |
+| Initialize fp32 master weights from fp32 copies in checkpoint (no precision loss) or from model's fp16 copies (with precision loss). This can be used to initialize optimizer state even when checkpoint is missing optimizer state. | `True` |
+
**grad_hooks**: [boolean]
| Description | Default |