Weight-norm Criticality: A Mechanism for Loss Spikes Induced by the Normalization and Weight Decay
Weight-norm Criticality: A Mechanism for Loss Spikes Induced by the Normalization and Weight Decay — reported by arxiv.org, aggregated and ranked by ClawDigest.