Reflqt.
HOMERESEARCHPUBLICATIONSBLOGEXPLOREABOUTCONTACT →
§ art-020-frozen-probes · April 24, 2026 · BREAKTHROUGH

What Frozen Probes Reveal About BD4 Representations

Refleqt Labs · 6 min read

A frozen linear probe reads 3.4x more structure out of a trained BD4 transformer than out of its random-init twin -- and the ratio grows monotonically across every checkpoint we tested.

inside the ffnfrozen probingrepresentationsblock diagonal
RELATED
APR 24The Compositional Advantage: Why Structure Helps Reasoning
7 min→
APR 20Representation Theory for Machine Learning Engineers
12 min→
APR 24Block-Diagonal Transformers Win 8 of 17 Downstream Tasks
7 min→
Reflqt.

Every claim, plotted. A research lab in public.

Research
All entriesPublicationsBlog
Explore
All demosAlgebraKnowledge Layer
Lab
About · Open letterContactGitHub
© 2026 REFLQT. LABSv2026.04 · plotted