Skip to content

All AI news

Today 0 items
Aug 18Tue
  1. Hugging Face Blog71

    Multi-Vector (Late Interaction) Embedding Models with Sentence Transformers

    Hugging Face announced on its official blog that Sentence Transformers v6.0 adds a fourth model type, MultiVectorEncoder, supporting ColBERT-style late interaction retrieval; any PyLate and Stanford-NLP ColBERT checkpoint can be loaded directly, and colpali-engine models can also be used for visual document retrieval.

    Why it matters: Official tutorials cover the full pipeline of loading, scoring, indexing, and compression, so readers can use them to decide whether multi-vector retrieval is worth adopting in their own search stack.

  2. Hugging Face Blog37

    Same Cluster, 33 Points More Utilization: What Changed Was the Order

    Hugging Face built a constraint-aware GPU allocator and benchmarked it against a FIFO scheduler across seven scenarios. On identical hardware and workloads, GPU utilization rose by up to 33 percentage points (for example, from 53.6% to 87.0% for an 8-GPU training-heavy workload), priority-weighted output increased in every scenario by up to 105%, averaging 52%. The key change is allocating real-time inference demand across time steps along its curve and placing batch-like tasks by priority across the whole scheduling horizon, rather than assigning by arrival order.

Aug 14Fri
Aug 11Tue
Jul 16Thu
  1. Hugging Face Blog32

    Newer Models, Same Advantage

    DharmaOCR scored 0.925 on a Brazilian Portuguese OCR benchmark, beating the newer Mistral OCR4 (0.798) and Unlimited-OCR (0.7587), confirming the value of domain specialization. The model uses supervised fine-tuning to align with Brazilian Portuguese vocabulary and document structure, then DPO to suppress repetitive or incoherent output, achieving the lowest degradation rate. The article argues that the reliability of generative OCR depends on how concentrated the parameters are within a single domain, not on a larger architecture.

Jul 10Fri
  1. Hugging Face Blog61

    Profiling in PyTorch (Part 3): Attention is all you profile

    Hugging Face published part three of its Profiling in PyTorch series, using the profiler on an NVIDIA A100 to compare traces of six attention implementations: naive attention, in-place masking, and SDPA math/efficient/flash/cuDNN.

    Why it matters: The original benchmarks kernel-level differences across six attention implementations with the profiler, teaching readers to read from traces how in-place saves a copy and what each SDPA backend really costs.

Jul 6Mon
  1. Hugging Face Blog47

    PRX Part 4: Our Data Strategy

    Hugging Face details the data pipeline for its PRX image generation model: mixing public and internal datasets for pretraining, using a VLM to regenerate long captions, then converting them into streamable training data. The text encoder has been switched to Qwen3-VL, with text latents computed online during training at a throughput cost of only about 3–4%. Images are uniformly encoded as JPEG quality 92, and the data is built with Lance and streamed for training via MDS (Mosaic Streaming).

Mar 11Wed
Jan 22Thu
  1. Mistral AI62

    Heaps do lie: debugging a memory leak in vLLM.

    The Mistral AI team investigated a memory leak of roughly 400 MB per minute in vLLM when running Mistral Medium 3.1 with graph compilation enabled in P/D disaggregated deployments.

    Why it matters: The article documents the full process of localizing the leak layer by layer from pmap and BPFtrace to GDB, which can be applied to similar kernel-level debugging of inference services.

Aug 1Fri
Apr 9Wed
Mar 4Tue
  1. Mistral AI31

    Empowering product development with an agentic workflow

    Mistral AI has launched TranscriptToPRDTicket, an agentic workflow that automatically turns meeting transcripts into PRDs and actionable development tickets. The workflow consists of two components, PRDAgent and TicketCreationAgent, both powered by Mistral Large 2, and can automatically create structured tickets in project management tools such as Linear and Jira. The full implementation is available via a Google Colab notebook.