NeoMME: an efficient Multimodal-native and Multilingual Encoder

H Company released NeoMME, a multilingual multimodal encoder in 260M and 800M sizes. A single bidirectional Transformer processes both text tokens and 32×32 image patches, trained from scratch with a masked discrete diffusion objective, with no reliance on a pretrained vision tower or a causal language model. Both versions are open-sourced under Apache 2.0.