LATENT LIBRARY DEEP LEARNING LanguageProcessingExplained From Words to Meaning, Before andAfter Large Language Models LATENT LIBRARY EDITORIAL

Language Processing Explained

From Words to Meaning, Before and After Large Language Models

Latent Library Editorial

IntroductionIntroduction

Large language models dominate today's conversation about AI, and for good reason: they write, summarise, translate and answer questions with remarkable fluency. But natural language processing (NLP) is a much older and broader field. Many language problems are solved better, cheaper, faster or more transparently by other methods: a keyword search, a regular expression, a small classifier trained on a few thousand examples, or a well-designed embedding search.

This book gives you the whole toolkit. It tells the story of NLP from text preparation and classic statistical methods, through word embeddings and sequence models, to transformers and large language models. Then it works through the main tasks (classification, extraction, search, summarisation, translation, question answering) with guidance on which approach fits which problem and how to evaluate the results.

The aim is judgement: knowing which tool to pick, why, and how to tell whether it works.

How the book is organised

Chapter 1Why Language Is Hard for Computers

Language looks easy because we use it effortlessly. For computers it is full of difficulty:

NLP methods differ mainly in how much of this they capture, and at what cost.

You have reached the end of the free sample.
The full book continues with 51 more chapters, plus the appendices.

Get the full book