Natural Language Processing
My notes and takeaways on natural language processing
Parsing
A note on syntactic parsing: constituency trees, context-free grammars, probabilistic parsing, CKY, and dependency relations.
Read note →
Model Evaluation
A note on how I think about evaluating language models, from benchmarks and overlap metrics to confidence and the limits of automatic scoring.
Read note →
Neural Language Models
From one-hot vectors to embeddings, CBOW, and Skip-gram: a note on how representation learning changed NLP.
Read note →
Transformers, From First Principles
A ground-up walkthrough of the transformer architecture, from tokens and embeddings to attention heads and residual streams.
Read note →
