Mastering Transformers

Transformer-based language models have dominated natural language processing (NLP) studies and have now become a new paradigm. With this book, you'll learn how to build various transformer-based NLP applications using the Python Transformers library.
The book gives you an introduction to Transformers by showing you how to write your first hello-world program. You'll then learn how a tokenizer works and how to train your own tokenizer. As you advance, you'll explore the architecture of autoencoding models, such as BERT, and autoregressive models, such as GPT. You'll see how to train and fine-tune models for a variety of natural language understanding (NLU) and natural language generation (NLG) problems, including text classification, token classification, and text representation. This book also helps you to learn efficient models for challenging problems, such as long-context NLP tasks with limited computational capacity. You'll also work with multilingual and cross-lingual problems, optimize models by monitoring their performance, and discover how to deconstruct these models for interpretability and explainability. Finally, you'll be able to deploy your transformer models in a production environment.
By the end of this NLP book, you'll have learned how to use Transformers to solve advanced NLP problems using advanced models.

J-Novel Club is a digital publishing company started by translators and fans like you! Our mission is to translate and release the coolest, funnest, and newest light novels from Japan to the world. By focusing on digital releases, and providing a membership service to let people read the books as soon as they are translated, our goal is to build a community of light novel readers and to grow the market, so that more and more releases can be officially licensed and translated. We won't just publish the big hit light novels that get anime adaptations, but also newer titles or books from small publishers and web novels... as long as it's a blast to read, we'll bring it to you! So pull out your tablet or ereader, sit down in a comfy chair, and join the club! weniger anzeigen expand_less