Ever since the groundbreaking research paper "Attention is All You Need" debuted in 2017, the concept of transformers has dominated the generative AI landscape. Transformers however are not the only ...