I watched this entire video where Sam Altman talks about novel architectures, and what they mean for the industry, about replacing the transformer as an attention mechanism, and the result of that ...