Skip to content

#多模态

Today 0 items
Jul 30Thu
  1. Google DeepMind67

    Gemini Robotics ER 2: powering robotics with video understanding, task orchestration, and multi-robot collaboration

    Google DeepMind released Gemini Robotics ER 2, positioned as a high-level embodied reasoning model for robots that can orchestrate low-level control interfaces such as VLA models and call tools like Google Search.

    Why it matters: Official benchmark numbers on progress classification and temporal grounding, plus multi-robot collaboration demos, let readers evaluate how usable this embodied reasoning model is for real-world robot orchestration.

  2. Google DeepMind46

    We’re launching Lyria 3.5 in Google Flow Music, with advances across musicality, lyrics, vocals, and creative control

    Google DeepMind has launched its latest music generation model, Lyria 3.5, available now in Google Flow Music. The model improves on musicality, lyrics, and vocals: it generates more natural and complex melodic structures, lyrics that better match prompts with structural awareness, and more expressive vocals with clearer articulation. Users also get easier control over the tempo and duration of the generated music.

Jul 16Thu
  1. Hugging Face Blog32

    Newer Models, Same Advantage

    DharmaOCR scored 0.925 on a Brazilian Portuguese OCR benchmark, beating the newer Mistral OCR4 (0.798) and Unlimited-OCR (0.7587), confirming the value of domain specialization. The model uses supervised fine-tuning to align with Brazilian Portuguese vocabulary and document structure, then DPO to suppress repetitive or incoherent output, achieving the lowest degradation rate. The article argues that the reliability of generative OCR depends on how concentrated the parameters are within a single domain, not on a larger architecture.

Jul 15Wed
  1. Hugging Face Blog80

    Welcome Inkling by Thinking Machines

    Thinking Machines has released the open-source multimodal model Inkling on Hugging Face, with about 1T total parameters (975B, a MoE with 41B active), natively accepting image, text, and audio inputs, supporting 1M context, trained on 45 trillion tokens, and shipping BF16 and NVFP4 weights.

    Why it matters: The official blog provides architecture details, VRAM requirements for each tier, and deployment configurations, letting readers evaluate multimodal deployment costs and model selection.

Jul 13Mon
Jul 3Fri
  1. Google DeepMind49

    Google DeepMind and A24 announce first-of-its-kind research partnership

    Google DeepMind and A24 have announced a first-of-its-kind research partnership pairing a frontier AI research lab with a film studio to help artists develop new workflows and techniques. The two will collaborate on long-term R&D across multiple projects: A24's filmmakers can help shape new technologies, while Google DeepMind gets guidance and feedback from working artists. Google has also invested in A24, and the partnership's specific goals and technical outputs will evolve over time.

Jul 1Wed
Jun 23Tue
  1. Mistral AI70

    Introducing Mistral OCR 4

    Mistral released the OCR 4 document parsing model, which beyond text extraction returns bounding boxes, typed block classification and per-word confidence scores, supports 170 languages across 10 language groups, and can be fully self-hosted via a single container.

    Why it matters: Sourced from Mistral officially, it covers OCR 4's structured output, multilingual support and self-hosting options, and also discloses benchmark scoring limitations, serving as a selection reference.

Jun 13Sat
Jun 9Tue
  1. Google DeepMind78

    Fluid, natural voice translation with Gemini 3.5 Live Translate

    Google DeepMind released the audio model Gemini 3.5 Live Translate, offering near-real-time speech-to-speech translation across 70+ languages with automatic language detection. It continuously generates translations that preserve the speaker's tone, rhythm, and pitch, lagging the speaker by only a few seconds.

    Why it matters: The official announcement details the model's capabilities, access options, and product integrations, helping readers judge how it changes real-time speech translation workflows.

  2. Google DeepMind76

    Introducing Gemma 4 12B: a unified, encoder-free multimodal model

    Google DeepMind released Gemma 4 12B, a unified, encoder-free multimodal model in which vision and audio inputs go directly into the LLM backbone, positioned between E4B and the 26B MoE.

    Why it matters: The article details the encoder-free architecture, 16GB-memory runnability, and Apache 2.0 open sourcing, helping readers evaluate on-device deployment options.

May 27Wed
  1. Mistral AI46

    Introducing physics AI at Mistral: the foundation for engineering acceleration.

    Mistral has acquired Emmi AI and launched a physics AI foundation model for engineering. Traditional CFD/FEM simulations take hours to weeks per design variant, while physics AI predicts physical fields with second-level forward inference on a single GPU, without replacing first-principles solvers. The capability is already used by partners including ASML, Airbus, Safran and Siemens Energy, spanning product design, tooling process design acceleration and real-time digital twins.

May 22Fri
  1. Google DeepMind29

    We’re launching the Google DeepMind Accelerator program in Asia Pacific to tackle environmental risks

    Google DeepMind launched the first cohort of its Accelerator program in Asia Pacific, themed “AI for the Planet.” The three-month program is open to regional startups, research teams, and nonprofits using frontier AI to tackle environmental problems in nature, climate, agriculture, and energy. Selected organizations receive expert mentoring and support integrating frontier and science AI models; it kicks off with an in-person bootcamp in Singapore and applications are now open.

May 18Mon
  2. Google DeepMind82

    Introducing Gemini Omni

    Google DeepMind launched Gemini Omni Flash, the first model in the Gemini Omni family, which can combine image, audio, video, and text inputs to generate videos, with multi-turn editing via natural language and support for character consistency and physical plausibility.

    Why it matters: The official introduction of the Omni family details the capability boundaries of conversational video editing, multi-input composition, and physical realism.

May 17Sun
  1. Google DeepMind61

    Making it easier to understand how content was created and edited

    On May 19, Google announced an expansion of its content transparency and verification tools, covering Search, Gemini, Chrome, Pixel, and Cloud.

    Why it matters: The original maps out how SynthID watermarking and C2PA Content Credentials verification are being extended across Search, Gemini, Chrome, and Pixel, along with rollout timing, to show where content provenance tools stand.

May 16Sat
  1. Google DeepMind46

    Strengthening Singapore’s AI Future: A New National Partnership

    Google DeepMind announced a new National Partnerships for AI initiative in Singapore, focused on healthcare, science, and education. The collaboration includes exploring an AI co-clinician "trio of care" with public healthcare clusters, using AlphaFold to accelerate outbreak research, developing a Gemma-powered running assistant for visually impaired runners, and providing Gemini for Education to all teachers from primary school through junior college.

  3. Google DeepMind84

    Gemini 3.5: frontier intelligence with action

    Google DeepMind has released the Gemini 3.5 model family, starting with 3.5 Flash, positioned for agents and coding. It outperforms Gemini 3.1 Pro on Terminal-Bench 2.1 (76.2%), GDPval-AA (1656 Elo), MCP Atlas (83.6%), and CharXiv Reasoning (84.2%), with output speed 4x that of other frontier models.

    Why it matters: The official release shares 3.5 Flash's benchmark scores, availability channels, and plans for a Pro follow-up, letting readers evaluate its trade-offs for agent and coding workloads.

May 2Sat
Apr 30Thu
  1. Google DeepMind61

    Enabling a new model for healthcare with AI co-clinician

    Google DeepMind has announced the AI co-clinician research program, exploring medical AI that assists both doctors and patients under physician supervision.

    Why it matters: The official announcement includes multiple sets of clinical evaluation figures and a dual-agent safety architecture, letting readers understand the capability boundaries and actual role of AI co-diagnosis assistants.

Apr 16Thu
Apr 14Tue
Apr 13Mon
Mar 25Wed
  2. Google Research38

    Mapping the modern world: How S2Vec learns the language of our cities

    Google Research, under its Earth AI program, introduced S2Vec, a self-supervised framework that learns universal embeddings of the built environment. It uses S2 Geometry to divide the surface into multi-resolution cells, rasterizes features such as buildings and roads into layered images, and applies masked autoencoding to learn location features without human labels.

Mar 18Wed
Mar 17Tue
  1. Mistral AI71

    Introducing Mistral Small 4

    Mistral AI released Mistral Small 4, the first small model to unify Magistral reasoning, Pixtral multimodal and Devstral agentic coding capabilities into a single model, open sourced under the Apache 2.0 license.

    Why it matters: The official release provides full architecture parameters, benchmark comparisons and deployment requirements, letting readers assess whether it can replace a multi-model stack.

Mar 12Thu
  1. Google Research62

    Protecting cities with AI-driven flash flood forecasting

    Google announced urban flash flood forecasting on Flood Hub, predicting risk up to 24 hours ahead. The model uses an LSTM architecture, trained on the Groundsource dataset of historical flash floods extracted from news reports with Gemini, relying only on global weather products, at 20x20 km resolution covering urban areas with population density above 100 people per square kilometer.

    Why it matters: The original provides the model method, coverage, and accuracy comparisons against the NWS, letting readers understand a viable path for urban flash flood forecasting.

Jan 10Sat
  1. Berkeley AI Research45

    Information-Driven Design of Imaging Systems

    Berkeley AI Research proposes a NeurIPS 2025 framework that evaluates and optimizes imaging systems directly on information content, using a mutual information metric to unify factors like resolution and noise. The method needs only noise measurements and a noise model to estimate information, and provides an upper bound on true information. Across color photography, radio astronomy, lensless imaging, and microscopy, the metric predicts decoder performance and its optimized results match SOTA end-to-end methods with lower memory and compute and no task-specific decoder.

Dec 17Wed
  1. Mistral AI60

    Introducing Mistral OCR 3

    Mistral AI has released Mistral OCR 3, which achieves an overall 74% win rate over Mistral OCR 2 on forms, scanned documents, complex tables, and handwritten content.

    Why it matters: The article provides the win rate comparison against Mistral OCR 2, pricing, and integration methods, so readers can assess the cost of switching their document parsing solution.

Dec 3Wed
  1. Mistral AI78

    Introducing Mistral 3

    Mistral has released its new Mistral 3 model series, including the MoE-architecture Mistral Large 3 (41B active, 675B total parameters) and Ministral 3 models in 3B, 8B, and 14B sizes, all open sourced under Apache 2.0.

    Why it matters: The official announcement fully lists model specs, open source licenses, deployment options, and available platforms, so readers can assess feasibility of running them in their own environments.

Nov 19Wed
  1. Mistral AI45

    Mistral - KI für Deutschland

    Mistral AI announced an expanded long-term strategic commitment in Germany: a partnership with SAP to build a fully sovereign AI stack for Germany and Europe, integrating its models into SAP's AI Foundation and co-developing industry-specific solutions; it will also accelerate work with Helsing on vision-language-action models for defense and security. Mistral will substantially grow its local German team and open a German office in the coming months.

Sep 2Tue
  1. Mistral AI53

    Make Memory work for you.

    Mistral AI introduced Memories (beta) in Le Chat, a hybrid approach combining automatic saving with visible recall, showing source links when memories are retrieved. The feature is designed around three principles—transparency, control, and sovereignty: users can turn off memory at any time, start incognito chats without memory, edit or delete individual memories, and export or import them.

Aug 1Fri
Jul 17Thu
  1. Mistral AI52

    Le Chat dives deep.

    Mistral AI rolled out a batch of new features for Le Chat: Deep Research in preview generates structured research reports with citations, voice mode is powered by the new Voxtral model, Think mode is driven by the reasoning model Magistral and supports switching languages mid-sentence, Projects groups conversations while preserving tool settings, and image creation and editing come via a partnership with Black Forest Labs.

Jul 15Tue
  1. Mistral AI70

    Voxtral

    Mistral released Voxtral, an open-source speech understanding model available in a 24B Voxtral Small and a 3B Voxtral Mini, both under the Apache 2.0 license and callable via its API at prices as low as $0.001 per minute.

    Why it matters: Official benchmarks and API pricing for two open-source speech understanding model sizes let readers assess whether Voxtral can replace their current ASR solutions.

May 7Wed
  1. Mistral AI64

    Medium is the new large.

    Mistral AI released Mistral Medium 3, positioned as a new class of model with SOTA performance at 8x lower cost. It reaches or exceeds 90% of Claude Sonnet 3.7 on benchmarks, is priced at $0.4 input / $2 output per M token, surpasses Llama 4 Maverick and Cohere Command A, and can be self-deployed on 4 or more GPUs.

    Why it matters: The official release provides benchmarks against Claude Sonnet 3.7, pricing, and deployment requirements, letting readers evaluate its cost-effectiveness for enterprise adoption.