Welcome to ABEL PyTorch’s documentation!¶
PyTorch implementation of ABEL LRScheduler based on weight-norm. If you find this work interesting, do consider starring the repository. If you use this in your research, don’t forget to cite!
Original paper can be found at arxiv.
Install¶
pip install abel-pytorch
Sample usage¶
import torch
from torch import nn, optim
from abel import ABEL
model = resnet18()
optim = optim.SGD(model.parameters(), 1e-3)
scheduler = ABEL(optim, 0.9)
for i, (images, labels) in enumerate(trainloader):
# forward pass...
optim.step()
scheduler.step()