Activity for transformer-in-transformer