Skip to content

Commit 8f68193

Browse files
authored
Update lamp.py comment
1 parent 4d28401 commit 8f68193

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

timm/optim/lamb.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -169,7 +169,7 @@ def step(self, closure=None):
169169
trust_ratio = one_tensor
170170
if weight_decay != 0 or group['use_nvlamb']:
171171
# Layer adaptation. By default, skip layer adaptation on parameters that are
172-
# excluded from weight norm, unless use_nvlamb == True, then always enabled.
172+
# excluded from weight decay, unless use_nvlamb == True, then always enabled.
173173
w_norm = p.data.norm(2.0)
174174
g_norm = update.norm(2.0)
175175
trust_ratio = torch.where(

0 commit comments

Comments
 (0)