Accelerate documentation

Learning how to incorporate 🤗 Accelerate features quickly!

Model Database's logo
Join the Model Database community

and get access to the augmented documentation experience

to get started

Learning how to incorporate 🤗 Accelerate features quickly!

Please use the interactive tool below to help you get started with learning about a particular feature of 🤗 Accelerate and how to utilize it! It will provide you with a code diff, an explaination towards what is going on, as well as provide you with some useful links to explore more within the documentation!

Most code examples start from the following python code before integrating 🤗 Accelerate in some way:

for batch in dataloader:
    optimizer.zero_grad()
    inputs, targets = batch
    inputs = inputs.to(device)
    targets = targets.to(device)
    outputs = model(inputs)
    loss = loss_function(outputs, targets)
    loss.backward()
    optimizer.step()
    scheduler.step()