ended5월 10일· 1 sources
Mapping the Neural Ghost: How Deterministic Weights Expose Model Inefficiency
신경망 속 '유령 가중치'의 발견: 모델 효율을 극대화하는 결정론적 초기화 기법
Why it matters
Traditional random initialization masks which specific weights actually contribute to learning, leading to significant structural waste. By implementing a hash-based deterministic approach, developers can now track every parameter's evolution without storage overhead, uncovering that over 60% of model weights may remain entirely 'dead' and prime for pruning.
1
Sources
+0
24h
—
Growth
133d
Active
Deterministic InitializationNeural NetworksWeight PruningSplitMix64Model Efficiency