Training HuggingFace models using fastai

Install 

pip install git+git://github.com/aikindergarten/fasthugs.git

How to use

Pre-training

Masked Language modeling

Fine-tuning

  1. Sentiment classification: IMDB
  2. GLUE benchmark
  3. Machine Translation
  4. Summarization
  5. Multiple Choice
  6. Token Classification

W&B sweeps

And more coming soon...

Acknoledgements

This library is lightweight wrapper for this two awesome libraries: HuggingFace transformers and fastai and is inspired by other work in same direction namely earlier fasthugs by @morganmcg1 and blurr by @ohmeow.