roofline
- Hardware entitlement to roofline: a 7-day curriculum
Take an op and a chip, work out from the documentation how fast the op can run, measure how fast it does run, and explain the difference. Seven days, built on AWS Trainium and Inferentia2, with a check-yourself problem for each.
- Tensor Engine clockwork: one matmul on Trainium, cycle by cycle
An interactive walk through what the Trainium/Inferentia Tensor Engine does on every clock of one nc_matmul: weights parked in a systolic array, inputs streamed in, partial sums falling into PSUM. Plus how the same picture shows up in a Neuron Explorer profile.