Apple researchers study why 'outlier tokens' form inside diffusion transformers

Apple researchers find that image-generating diffusion transformers develop the same 'outlier token' quirk seen in vision transformers.