#

stable-llm-pretraining

Here is 1 public repository matching this topic...

bluorion-com / ZClip

Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".

loss adaptive-gradient-clipping loss-spike adaptive-clipping zclip stable-llm-pretraining enable-high-learning-rate traning-stability pre-training-stability stable-training llm-stable-training

Updated Apr 28, 2025
Python

Improve this page

Add a description, image, and links to the stable-llm-pretraining topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the stable-llm-pretraining topic, visit your repo's landing page and select "manage topics."