Datasets for LLM SFT
A collection of datasets in the format of instruction-context-completion to use for instruction-following fine-tuning of LLMs
Alvaro Bartolome
alvarobartt
Research interests
ml @argilla / open-source and machine learning
Blog posts
Organizations
Collections
2
GPT-2 from scratch
Reading list to fully understand GPT-2 and be able to implement it from scratch.
-
Neural Machine Translation of Rare Words with Subword Units
Paper • 1508.07909 • Published -
Attention Is All You Need
Paper • 1706.03762 • Published • 6 -
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Paper • 1810.04805 • Published -
Generating Wikipedia by Summarizing Long Sequences
Paper • 1801.10198 • Published
models
4
datasets
None public yet