Fine-tune Transformers with AWS Trainium

Training on AWS Trainium is as simple as in Transformers:

• You need to replace the Transformers’ Trainer class with the NeuronTrainer class.

You can find several examples in the official repository for the following tasks:

• language modeling,
• question answering,
• summarization,
• text classification,
• translation,
• image classification,
• audio classification,
• speech recognition,
• contrastive image-text training.

If you want go through an step-by-step example check out the getting started with AWS Trainium and Model Database Transformers guide.