Attention Heads

Loading editor

Attention Animation – Transformer Heads Weighting Each Word

Attention Heads

About Attention Heads

Each word in turn attends to the others, its links thickening with the weight it gives them as the heads cycle through.

Animate transformer attention with each word weighting the others as the heads cycle, for LLM, NLP and AI architecture explainers.

Part of Networks & AI. New to this kind of graphic? Read How to Animate a Neural Network Diagram for a Video.

Transparent exports and editor imports are explained in the transparent video guide, and every download is free under the commercial license.

Category
Networks & AI
Length
10 seconds, up to 60 seconds
Playback
Plays once
Controls
14 editable
Format
MP4 · WebM · PNG sequence
Alpha
WebM or PNG sequence
Resolution
720p to 8K
Aspect
16:9 · 9:16 · 1:1 · 4:5
Works with
Premiere Pro · After Effects · DaVinci Resolve · Final Cut Pro · CapCut · Figma
License
Commercial use included
Cost
Free · no account · no watermark

Frequently asked

What can you customize in Attention Heads?

Content: title and labels. Typography: font. Style: background, text color, primary, secondary, accent and thickness. Layout: aspect ratio and scale. Motion: duration, speed and variation.

How long is Attention Heads?

Attention Heads runs 10 seconds by default, and you can set any length up to 60 seconds before you export. It plays once.

How to use Attention Heads

Attention Heads helps explain why transformer models handle context well. Watching one word's links thicken toward the words it depends on makes a hard idea visual, which suits lecture videos, technical blog companions and conference talks on model architecture.

  • Enter your own sentence in Labels one word per entry; six to eight words keeps the links readable.
  • Slow Speed so the audience can see each word take its turn before the next head cycles in.
  • Raise Thickness so the heaviest attention links remain clearly visible on small screens.

Related animations

  • Tokenizer Split

    A sentence breaks apart into coloured token chips that settle into rows, each labelled with its own token id.

  • Code Completion

    An editor panel types your lines, then a dimmed AI suggestion streams in after the caret and turns solid when it is accepted.

  • Prompt to Answer

    A prompt types into the input box, the send button taps and the answer streams back token by token under a moving shimmer.

  • Agent Graph

    A labelled node graph builds itself edge by edge with arrowed links, then packets run the routes between agents.

  • AI Voice Orb

    A glowing assistant orb moves through idle, listening, thinking and speaking, its waveform rising and falling with each state.

  • Anomaly Detection

    A metric traces along inside its normal band until one reading spikes clear of it and gets ringed and flagged.

  • API Request Flow

    A request packet carries the endpoint across to the API, the server pulses while it works, and the response returns with its status.

  • Blockchain Link

    New blocks with hash labels slide in, pulse and chain onto a scrolling ledger while data flows through the links.