Posts, articles, and discussions
Community posts

How we sped up transformer inference 100x for 🤗 API customers
By January 18, 2021

Leveraging Pre-trained Language Model Checkpoints for Encoder-Decoder Models
By November 9, 2020

Porting fairseq wmt19 translation system to transformers
By November 3, 2020

Hyperparameter Search with Transformers and Ray Tune
By November 2, 2020 guest

Transformer-based Encoder-Decoder Models
By October 10, 2020
Retrieval Augmented Generation (RAG)

By September 28, 2020

Block Sparse Matrices for Smaller and Faster Language Models
By September 10, 2020

The Reformer - Pushing the limits of language modeling
By July 3, 2020
Long Form Question Answering with ELI5

By June 17, 2020
How Big Should My Language Model Be?

By June 8, 2020
Zero Shot Topic Classification

By May 29, 2020

How to generate text: using different decoding methods for language generation with Transformers
By March 1, 2020

How to train a new language model from scratch using Transformers and Tokenizers
By February 14, 2020