Representation theory turns abstract group symmetries into concrete matrices you can compute with. This article walks through the core ideas -- from irreducible representations to the Peter-Weyl theorem -- with worked examples using S_3 and S_4, and shows why these structures keep appearing in neural network weight matrices.