The most efficient training systems are designed around the specific model architecture, where parallelism strategy, kernels, networking, precision and memory hierarchy are all part of the model performance story. This is a move away from generic training infrastructure patterns.