跳到正文
The Decoder· Matthias Bastian·· 4 小时前AI 评分59

百度发布 2800 亿参数开源基座模型 ERNIE 5.5 Flash Base

Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an open-source foundation model

AI 导读

百度发布开源基座模型 ERNIE-5.5-Flash-Base,刻意不做微调或后训练,由开发者自行决定用途,后训练版本后续推出。模型采用 MoE 架构,总参数 280B、每输入激活 14B,预训练数据 33.5 万亿 token,训练上下文最长 128,000 token,设计上在微调和推理阶段支持最长 100 万 token 上下文。

正文 · 原文

Baidu's AI development is still alive, but most of the work is on you. The Chinese company has released ERNIE-5.5-Flash-Base, an open foundation model that ships deliberately without fine-tuning or post-training. Developers are expected to decide for themselves where to take the model. A post-trained version is supposed to follow.

ERNIE 5.5 uses a mixture-of-experts architecture with 280 billion parameters, 14 billion of which are active per input. The model was pre-trained on 33.5 trillion tokens with a training context of up to 128,000 tokens, though it's designed to support a context of up to one million tokens during fine-tuning and inference.

Benchmark results for ERNIE 5.5 Flash Base compared to DeepSeek-V4-Flash-Base, Hy3-preview-Base, and MiMo-V2.5-Base, tested with the same evaluation pipeline across the categories Exam, STEM, Reasoning, Knowledge, Code, Multilingual, and Long Context. | Image: Baidu

In benchmarks for reasoning, code, and long-context tasks, the model competes with similarly sized open foundation models like DeepSeek V4 Flash or MiMo V2.5, according to Baidu. The weights are available on Hugging Face in FP8 and BF16.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

来源: The Decoder · the-decoder.com