Natural Language Processing

Author

Chao Ma

Published

June 6, 2026

Notes on natural language processing, from classical system-building approaches to modern neural and reinforcement-learning methods for language models.

CMU Advanced NLP Lecture 2: Learned Representation Tokenization, token embeddings, CBOW, Deep CBOW, training losses, and a small sentiment-classification experiment comparing shallow and deeper bag-of-words models.

CMU Advanced NLP Lecture 1: Introduction and Fundamentals NLP system-building methods from rules to supervised learning and reinforcement learning, plus the common ingredients of parameterization, learning, inference, softmax probabilities, and generation.

---
title: "Natural Language Processing"
author: "Chao Ma"
date: "2026-06-06"
---

Notes on natural language processing, from classical system-building approaches to modern neural and reinforcement-learning methods for language models.

---

::: {.content-grid}

::: {.content-card}
**[CMU Advanced NLP Lecture 2: Learned Representation](cmu-advanced-nlp-lecture-2-learned-representation.qmd)**
Tokenization, token embeddings, CBOW, Deep CBOW, training losses, and a small sentiment-classification experiment comparing shallow and deeper bag-of-words models.
:::

::: {.content-card}
**[CMU Advanced NLP Lecture 1: Introduction and Fundamentals](cmu-advanced-nlp-lecture-1-introduction-fundamentals.qmd)**
NLP system-building methods from rules to supervised learning and reinforcement learning, plus the common ingredients of parameterization, learning, inference, softmax probabilities, and generation.
:::

:::