Python Futures

Transformer pro and contra

O(n^2)

O(1)

Parallelization

Transfer learning

Pre-training

matmul() vs einsum()

Theory

Case studies

Covariance Shift and Inductive Priors

Covariance Shift

Regularization

Drop Out

Label

Smoothing

Regularization vs Normalization

Inductive Priors

Python Iterators and Generators

Transformer distiled, Part 2 of 2

Regularization

Self- vs Cross-Attention

Adding vs concatenating positional encoding