The MAMBA design transformer using a language modeling head on best (linear layer with weights tied towards the input  Luso-Americano also serves as a leading informational useful resource to your Portuguese media in https://k2spiceshop.com/product/liquid-k2-on-paper-online/