Recap on ML

Functions are treated as objects and can be used as arguments or return values for other higher functions. This paradigm is called first-class functions. A built-in example in python would be map() which takes a function as an argument.

An overview of the core mathematical components of the Transformer architecture, covering scaled dot-product attention, softmax, multi-head attention, linear layers, and learned embeddings.