@nleadholm compares Transformers and Monty implementation circa 2023, focusing on Self-Attention and Voting. It also briefly compares Self-Attention and Reference Frames. After a short overview of embodied transformers, the video concludes with ideas for possible Transformer improvements. We highlight that this was a brainstorming session, but modifying transformers with Monty concepts is not something that the Thousand Brains Project is working on.