Studio hour·60 minutes

Studio Hour: Attention Trace

Trace one query through masking, normalization, value mixing, and a multi-head output boundary.

Scenario

An attention implementation produces plausible vectors even when future tokens receive probability mass.

You will demonstrate

  • Inspect masked scores.
  • Verify probability mass.
  • Trace value mixing.

Project evidence

Show the work, not a checked box.

Each response is stored in this browser as you type. Include metrics, test output, or a decision rationale wherever the deliverable asks for it.

1

Publish the attention trace

Record query/key scores, the mask, normalized weights, their sum, selected value mixture, head shapes, and one invariant that would catch a future-token leak.

Required evidence: A token-level trace table and a deterministic masking assertion.

0/80 minimum characters

Runnable Python lab

Normalize only allowed keys

Apply a Boolean causal mask before softmax and verify that probability mass stays on allowed positions.

Project defense

What must a causal attention trace show for a future key?

Rubric self-review

Rate the evidence, not your effort: 0 missing, 1 weak, 2 adequate, 3 strong. All criteria must be reviewed, but a low honest score does not get hidden.

The trace connects scores, masking, softmax, value mixing, head dimensions, and a falsifiable invariant.

Useful references

Project completion gate

Completion is controlled by stored evidence, deterministic tests, a decision defense, rubric review, and the artifact when required.

Evidence pendingCode pendingDefense pendingRubric pending

Optional cloud portfolio

Submit evidence across devices.

An account is required. Submit only when the local completion gate passes. AI review is advisory and separate from deterministic completion.

Account settings