Memory Palace

Natural Language Processing

My notes and takeaways on NLP

Apr 2026·Topic Page·NLP

I wanted this section to be a place where I can organize my NLP notes more carefully instead of keeping everything on one long page. Some of these entries are technical summaries, some are concept notes, and some are simply my way of understanding the foundations more clearly by writing them out.

Right now, I am especially interested in the representational side of NLP: how words become vectors, how context changes meaning, and how architectural shifts like the transformer changed what language models can learn at scale. I also like tracing how older ideas still quietly sit underneath newer ones. Even when the field moves fast, the basic conceptual questions remain surprisingly stable.

A note to self

Begin with attention, then return to evaluation.