Skip to content

#多模态

Today 0 items
Oct 7Wed
  1. Google DeepMind68

    EmbeddingGemma 2: an open, lightweight multimodal embedding model

    Google DeepMind released EmbeddingGemma 2, a 740M-parameter model built on the Gemma 4 architecture under the Apache 2.0 license, mapping text, code, images, video and audio into a shared embedding space.

    Why it matters: The official release provides concrete metrics such as parameter count, memory footprint and benchmark scores, helping readers judge whether it suits on-device retrieval scenarios.

  2. TechCrunch · AI42

    Ex-Ramp engineers raise $20M for platform Melius after scrapping their first product

    AI ad creative platform Melius announced on Tuesday a total of $25 million in funding, including a $20 million Series A led by CRV and a $5 million seed round led by General Catalyst. Founded by three former Ramp engineers, the company pivoted to a "creative work agent lab" that generates ad assets and campaigns after abandoning its original AI marketing tool and rewriting its entire codebase, and says it topped $1 million in annualized revenue within two months of stealth exit in July.

Oct 2Fri
  1. TechCrunch · AI62

    ChatGPT can now virtually try on clothes for you

    OpenAI announced the global rollout of two new ChatGPT shopping features: virtual try-on and Favorites. Users can upload selfies or full-body photos to try on clothing and accessories, or upload product screenshots to request try-ons; the try-on feature is based on the newly released ChatGPT Images 2.5 model. Favorites lets users save products to the in-app Library.

  2. The Decoder55

    Nearly half of test subjects mistook Tavus' AI video avatar for a real person on a one-minute call

    Tavus launched Griffin, which it calls the first Human Interaction Model, capable of processing speech, facial expressions, tone, gestures and pauses in real time and generating video bidirectionally. In the company's research, 48% of participants thought Griffin was a real person after a one-minute video call, versus a previous high of 2%; in what Tavus says was independent testing by Nvidia, Griffin scored 3.83, close to 3.92 for a real person.

Oct 1Thu
  1. TechCrunch · AI59

    Google releases Gemini 4 Argon, called its most powerful model yet

    Google released its new model Gemini 4 Argon, saying it excels at cybersecurity, coding, and research, and can autonomously discover, verify, and fix critical software vulnerabilities. The model was specifically trained on defensive cybersecurity tasks and is currently available only to select cybersecurity partners through the Fairwind security program; Google, citing Vals' model index, says it leads OpenAI GPT-6 Astra and Anthropic's Fable and Opus on multiple benchmarks.

Sep 30Wed
  1. Hugging Face Blog63

    Open TTS Leaderboard: Scalable Evaluation for Multilingual Text-to-Speech and Voice Cloning

    Hugging Face has launched the Open TTS Leaderboard, evaluating open-source TTS models with objective metrics including Qwen3 ASR WER/CER, RTFx and TTFA on H200, and WavLM speaker similarity, cutting per-model evaluation time from about two weeks to hours.

    Why it matters: The post explains how objective metrics shrink TTS evaluation from weeks to hours, and why mainstream arenas structurally underrepresent open-source models.

Sep 29Tue
  1. Microsoft Research62

    Introducing Quine: An AI research system designed for the complexity of biology

    Microsoft Research launched Quine, a research system combining a multimodal world model of biology with an interactive framework connecting scientific tools, literature, and researchers. With the Broad Institute, it applied the system to pancreatic ductal adenocarcinoma (PDAC) research, predicting and ranking compounds that could drive tumor cell state transitions; wet-lab validation confirmed top-ranked candidates, and narrowing the compound pool to validation candidates took just one weekend.

    Why it matters: Microsoft's official introduction covers Quine's architecture and real PDAC cancer research results, showing readers how AI world models can compress wet-lab iteration cycles.

  2. Latent Space52

    [AINews] AMD buys World Labs for $8.2B, as Atlas solves sparse reconstruction problem for robotics, design and more

    AMD acquired World Labs; since AMD is a listed company, the author notes the acquisition price was $8.2 billion. World Labs, founded in 2024, built training teams for image, video and spatial reconstruction, and after acquiring SceniX targeted robot simulation. Its Atlas model, trained from scratch, can predict the next viewpoint from 2D images, combining generative models with multi-view geometry and essentially solving the long-standing sparse reconstruction problem in computer vision, with applications in robotics RL environments, scene generation and real estate reconstruction.

Sep 28Mon
Sep 26Sat
Sep 25Fri
  1. Google Research54

    Automating coherent long-form video generation

    Google Research unveiled its AI video co-director research, building a multi-agent orchestration layer based on Gemini and Veo with four frameworks — Co-Director, CANVAS, A²RD and VQQA — that reformulates long-form video generation as a global optimization and world-state tracking problem.

Sep 24Thu
  1. Hugging Face Blog60

    Accelerating vision-language models with LFM2.5-VL-DSpark

    Liquid AI has released experimental DSpark draft models for the vision-language model LFM2.5-VL-3B, using speculative decoding to trade for faster inference without changing output quality — decoding speeds up to 3.13x on-device and 2.66x on H100, with end-to-end gains up to 2.62x and 2.27x respectively.

    Why it matters: The article details a speculative decoding acceleration scheme for vision-language models with concrete speedups and memory overhead, plus integration guidance for llama.cpp, MLX-VLM, and SGLang.

Sep 23Wed
Sep 18Fri
  1. Google Research47

    The future of practice: Enabling teachers to create learning interactives with generative UI

    Google Research launched a new research experiment where teachers can use generative UI (GenUI) to dynamically generate customized, guided interactive learning simulations based on their teaching goals and curriculum. Built on active learning principles from the LearnLM education model family, the release includes over 30 AI-generated, teacher-reviewed English STEM learning interactives covering physics, chemistry, biology and math for middle and high school.

Sep 16Wed
Sep 3Thu
  1. Hugging Face Blog52

    NeoMME: an efficient Multimodal-native and Multilingual Encoder

    H Company released NeoMME, a multilingual multimodal encoder in 260M and 800M sizes. A single bidirectional Transformer processes both text tokens and 32×32 image patches, trained from scratch with a masked discrete diffusion objective, with no reliance on a pretrained vision tower or a causal language model. Both versions are open-sourced under Apache 2.0.

Sep 2Wed
  1. Google DeepMind70

    Introducing agentic video understanding with Gemini

    Google DeepMind released agentic video understanding for Gemini 3.7 Flash, 3.6 Flash and 3.5 Flash-Lite, replacing static 1 FPS processing with dynamic searching and inspection of video segments; official benchmarks show up to 66% lower cost, up to 88% fewer tokens, and up to 7% higher accuracy.

    Why it matters: The official release gives concrete cost, token and accuracy figures plus how to enable it, letting developers directly assess switching their existing video processing pipelines.

Sep 1Tue
Aug 28Fri
  1. Google Research50

    Planetary prediction engine: Automating global models via Earth AI

    Google Earth AI has introduced an experimental research capability called the Planetary Prediction Engine (PPE), which autonomously performs the full geospatial prediction workflow—data discovery, cleaning, feature engineering, model training, and evaluation—starting from natural language queries, compressing work that previously took weeks of manual data engineering down to a few minutes.

  2. Google DeepMind60

    Gemini Omni 1.1 Flash lets you build with more control

    On August 27, Google DeepMind released Gemini Omni 1.1 Flash, bringing a suite of creative controls for generative video aimed at developers, available via the Gemini API in Google AI Studio.

    Why it matters: The official release provides specific parameters for new capabilities like scene extension, keyframe interpolation and 4K upscaling, along with access channels, so developers can evaluate adopting it in generative video workflows.

Aug 26Wed
Aug 21Fri
  1. Microsoft Research50

    Broadening access to Skala creates a faster path to predictive DFT

    Microsoft Research released Skala 1.1, trained on 2.5 times the data of the previous version, ranking first in 32 of the 55 categories of the GMTKN55 benchmark with a weighted average error of 2.8 kcal/mol at compute cost comparable to a meta-GGA functional. Skala is now available in CP2K and being integrated into Psi4, FHI-aims, ORCA, and VASP, alongside a dynamic benchmark tracking each version's computational performance.

Aug 17Mon
Aug 13Thu
  1. Microsoft Research44

    MindTopo reveals VLMs’ spatial reasoning abilities

    Microsoft Research introduced the MindTopo benchmark, evaluating multimodal large models' ability to reason about and plan with topological concepts such as connectivity, closure, ordering, separation, and knots. Testing shows models perform markedly better on static image recognition than on interactive planning tasks, and both fall far short of human level, with errors mostly involving lost structural relations during planning or physically infeasible actions. The benchmark aims to provide a controlled diagnostic tool for research on agents in robotics and interactive environments.

Aug 12Wed
  1. Google DeepMind74

    Putting sign language AI into users’ hands

    Google DeepMind released a large-scale multilingual sign language-to-text (SL2T) translation model, bringing new sign language input features to deaf and hard-of-hearing users, first supporting American Sign Language (ASL) to English in Gboard and Live Transcribe on Pixel 11, with more devices and languages to follow.

    Why it matters: The article gives concrete details on training scale, benchmark scores, and privacy design, letting readers understand the real technical path to deploying sign language translation.

  2. Google Research65

    Advancing AMIE towards expert-level audio-visual clinical consultations

    Google Research has launched AMIE (Video), built on Gemini and Project Astra, which can conduct real-time synchronized clinical video consultations, perceive non-verbal cues, and guide virtual physical exams.

    Why it matters: The article covers the architecture, evaluation scale, and quantitative comparisons against primary care physicians (PCPs), while candidly noting limitations like simulated scenarios, helping readers understand the practical boundaries of audio-visual clinical AI.

  3. Microsoft Research58

    Introducing CARE-X: Towards Clinically Useful Radiology VLMs with Auxiliary Supervision, Reward-Aligned Learning, and Tool-Augmented Measurement

    Microsoft Research introduces CARE-X, a research model and unified chest X-ray VLM built on SigLIP2-so400M and Phi-4-mini-instruct (3.8B), jointly trained with auxiliary heads to provide report generation and structured predictions with confidence, and aligned to clinical rewards using DAPO reinforcement learning.

Aug 10Mon
  1. Hugging Face Blog78

    Meta is back with Muse Glimmer: local, agentic, multimodal, and open source

    Meta today released Muse Glimmer, a 30B-parameter open-source multimodal model distilled from Muse under the Apache 2.0 license, aimed at privacy-focused local deployment and agentic uses like coding, document analysis, and personal assistance.

    Why it matters: The article provides architecture details, agent benchmark comparisons, and day-0 usage across inference stacks, helping readers evaluate local multimodal deployment options.