Profiling in PyTorch (Part 3): Attention Is All You Profile

Part 3 of a PyTorch profiling series zeroes in on attention layers, showing where transformer training time actually goes.