260930_looped
🔥🔥 Do shared weights mean the same computation at every loop? 🔁 In our new paper: Shared Weights, Selected Computations, we study how hidden states and attention route different computations through looped Transformers.
🔥🔥 Do shared weights mean the same computation at every loop? 🔁 In our new paper: Shared Weights, Selected Computations, we study how hidden states and attention route different computations through looped Transformers.