#Hugging Face

Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline

FlashMask-3: Efficient and Expressive Mask-Aware Distributed Attention

Long-context training of large language and multimodal models couples structured attention masks (document, prefix-LM, share-question, sliding-window, block-sparse) with multi-node context parallelism, making the mask a dominant bottleneck.

Gen4P: Video Generators are 4D Perceivers

We introduce Gen4P, a unified framework for recovering 4D geometry and motion from monocular video. We show that a pretrained video generator can be repurposed into a feed-forward 4D perceiver without iterative denoising.

MMSearch-OPD: Easy Made Hard, Hard Made Learnable for Long-Horizon Multimodal Search Agents

Multimodal deep search is moving from short queries to long-horizon investigations that continually acquire evidence.

Data World: Scaling Data Environments from Scratch

Data agents use code to process heterogeneous files and derive analytical insights. Scaling their training faces costly environment curation, privacy and intellectual-property restrictions, and difficulty verifying open-ended findings…

ForcingBooster: Adaptive Patch-wise Denoising for Fast Autoregressive Video Diffusion

Autoregressive video diffusion models have become a leading approach to real-time interactive video generation and video world modeling.

Beyond Policy Rollouts: Embedding-Space Directional Exploration with Anchored Noise for LLM RLVR

Reinforcement learning with verifiable rewards (RLVR) typically uses small rollout groups per prompt, where repeated sampling from the same policy can yield highly similar trajectories, reducing within-group reward variation and weakening…

SERO: Learning from Executable Oracle Continuations for Long-Horizon Agentic Reinforcement Learning

Long-horizon agentic RL is constrained by the futures visited by the current policy. When rollouts fail to reach useful behaviors, improved credit assignment cannot provide supervision for states and actions that were never encountered.

RoTA-Bench: Evaluating 3D Spatial Reasoning through Interactive Projection Alignment

Can vision-language models turn 2D observations into 3D understanding that supports precise action? This requires inferring object geometry, anticipating the effects of rotation, and refining actions through visual feedback.

Scalable Weak-to-Strong Verifier Hardening for Agent Environments

Agent environments are essential for large language model (LLM) development. They use programmatic verifiers to turn complex outcomes into rewards.

LEASH: Uncertainty-Aware Weak-to-Strong Escalation and Oversight for Computer-Use Agents

Computer-use agents increasingly tackle long-horizon tasks, where running a frontier model at every step is expensive and a small open-weight model alone often fails.

Speech event detector: Timestamped detection of non-verbal vocalizations and background sounds for rich speech transcription

Automatic speech recognition produces words but drops the non-verbal content of a recording: the breaths, coughs, sighs and laughter of the speaker, and the horns, music or barking around them.

Each Reward to Its Relevant Tokens: Reward-Specific Token-Level Credit Assignment for Multi-Reward RL

Language models are increasingly trained against several verifiable rewards at once, such as the correctness and the format of a tool call, or the individual constraints of a complex instruction.

CarryOn: A Dual-Loop Harness for Personalized and Reliable Robot Assistance

While generalist vision-language-action (VLA) models have enabled diverse open-world manipulation, real-world robotic assistance requires two critical capabilities they currently lack: personalization and reliable execution.

PathFM: Fast Generative Forecasting of Multivariate Trajectories

Time series foundation models are becoming increasingly popular for general-purpose forecasting. However, most leading models predict marginal quantiles, leaving the dependence structure of future trajectories unspecified.

Behavioral Compositionality of Sparse Autoencoder Representations

Sparse autoencoders (SAEs) represent model activations with sparse, linearly decoded features, but the downstream effects of those features need not compose additively.

FDE-Gym: The Last Mile of AI Delivery

Existing agent benchmarks typically evaluate agents on well-specified tasks defined by issue reports, specifications, or task tickets.

Explaining the Roles of Experts in Mixture-of-Experts LLMs for Personalization

Personalization of Large Language Models (LLMs) is increasingly important for user-centric applications, yet prior methods mainly adapt dense LLMs, whose polysemantic neurons, each encoding multiple unrelated concepts, hinder localizing…

Diminishing Returns of Data in Sparse Autoencoders: Functional Behavior does not Guarantee Feature Reproducibility

Sparse autoencoders (SAEs) are typically trained on hundreds of millions to billions of activation tokens, yet little work has tested whether this scale is necessary.

Copy-Paste Language Models

Transformers are intuitively considered to be efficient at copying from their inputs. We actually show that the ability of LLMs to copy in context can be improved through explicit modeling.

H-DDCM: Hadamard Codebooks for Fast Generative Image and Video Compression

Training-free diffusion-based compression methods repurpose the generative priors of a diffusion or a flow model to compress data without retraining them as task-specific codecs.

One Bias Score, Two Factors: How Mitigations Affect Option Bias in Multiple-Choice Evaluation

Reordering multiple-choice options can change a model's answer, an effect studied as selection bias (a preference for certain option letters) and as order sensitivity (changes in answers across option orderings).

Trajectory-Level Speculation with Semantic Verification for Tool-Using Agents

Large language model agents solve tasks through long sequences of tool calls, and the prevailing design has a single strong model generate every step, although many steps are routine enough for a much smaller model.

PAIR: Bridging Perception and Action in Vision-Language-Action Models

Vision-language-action (VLA) models map visual observations and language instructions to continuous robot actions.

CoDA: Co-Evolution of Data Engines and Action Policies

Generative simulation can automate robot environment construction, but physically valid environments are not necessarily useful for training.

When the KV Cache Is Slower Than the GPU: Scaling Remote KV Tiers for Context-Parallel Prefill

Reusing the attention KV cache across requests is a standard way to cut prefill cost in long-context LLM serving, and production systems increasingly back the per-engine cache with a remote tier shared by every engine.

AI-Driven, Timing-Aware Power Optimization

Post-route power recovery changes cell choices under tightly coupled timing, electrical and physical constraints, and the value of each change depends on what it costs to repair its side effects.

Self-Evolving Agent Harness

Harness self-evolution revises an agent's software scaffolding, including prompts, memory, workflows, and executable components, while keeping model weights fixed.

OpenGCUA: Toward a Fully Open Stack for Generalist Computer Use

Computer use has reached a turning point: the focus is expanding from GUI-only interaction to systems that complete tasks on users' computers through visual and programmatic interfaces.

SUPRA-TEX: 3D Generation with Super-Aligned Texture

Single image 3D generation aims to dress a given 3D mesh with relightable materials while faithfully preserving the visual details of a reference image.

OmniVerifier-C1: Decomposed Graded Verifier for Rule-Governed Generative World Modeling

Generative visual verifiers play a crucial role in advancing multimodal intelligence. To enhance the robustness of visual verifiers in complex multimodal scenarios involving compositional requirements, we move beyond conventional binary…

Welcome Beam: a 501B open model you can own, customize, and scale

VascuSR: Iterative Anatomy-Aware Diffusion for CT Super-Resolution

Generative super-resolution (SR) can recover sharp detail in computed tomography (CT) images from severely downsampled observations, but the missing high-frequency content is not uniquely determined by the low-resolution input.

Mine, Sample, Render: Test-Time Diversity Alignment Of Generative Models

Modern generative models produce high-quality individual outputs but struggle to sample diversely, even when explicitly instructed to do so.

WorldCast: Exploring Intelligent Visual Generation in World State Prediction

Humans interpret multimodal observations of the world and forecast how it will evolve. Recent multimodal generative systems have demonstrated similar capabilities: they can integrate multimodal context and synthesize visual outputs that…

LeanPRM: Lean-Grounded Process Supervision for Natural Language Proof Verification

AI systems now write long and difficult mathematical proofs, and checking their step-by-step validity is becoming a bottleneck.

MAI-Gym: An Open All-in-One Platform for GUI Agent Evaluation and RL Training across Mobile and Computer Environments

Online reinforcement learning (RL) with verifiable rewards has driven rapid progress in mathematics, coding, and tool use, but scaling this success to GUI agents remains challenging due to the high cost of interactive environments and the…

Learning Self-Orchestration in Decentralized Agent Swarms

The capabilities of an agent swarm depend on both its individual members and how they coordinate.

Cowork-Gym: Synthesizing Interactive Work Environments at Scale

Cowork agents navigate dependencies across tools and files while adapting to changing user requirements and edits to shared workspaces.

Virtual Head Attention

The design of attention mechanisms in long-context large language models faces an impossible triangle'' among KV cache size, training and prefill FLOPs, and model quality.

MJev-Spatial: System One Spatial Intelligence via Native Attention Matching

Spatial intelligence lets an agent perceive and act in the physical world, and many of its judgments must be made at interaction rates: which spatial relation holds, how far an object is, or where to place it.

Recursive Environment Scaling for General Long-Horizon Agents

We study environment scaling as a way to increase agent-benchmark difficulty while holding core task objectives fixed.

Equal CER, Unequal Damage: Severity-Weighted Character Error Rate for OCR

Character Error Rate (CER), the standard metric for OCR and vision-language models (VLMs), charges a typo as much as a wrong name.

VLA-Δ: Learning Physical State Transition for Vision-Language-Action Models

Vision-language-action (VLA) models transfer semantic knowledge acquired through vision-language pretraining to robot control, achieving strong performance across various benchmarks.

PINT: A Unified Model with Shared Predictive Intent for Robot Manipulation

Generalist robot manipulation can benefit from pretrained vision-language models (VLMs) for semantic reasoning and video generation models (VGMs) for world modeling.

Learning to Read Out: Unembedding Dynamics in Language Model Pretraining

When does a language model acquire a capability? Developmental studies usually answer this by tracking when models start producing the correct token.

Waypoint-OPD: Transferring RL-Induced Policy Shifts via Gated On-Policy Distillation

Policy-shift distillation reuses the difference between a teacher's log probabilities before and after reinforcement learning (RL) as supervision on student-generated trajectories.

CoWorld Reasoner: Agentic Multimodal Reasoning with the Evolving Video World Model-Driven Harness

As Vision-Language Models (VLMs) advance, they are increasingly expected to perform spatiotemporal reasoning over motion, actions, and view changes beyond what the input images show.

Mosaic: Multi-Session Agentic Reinforcement Learning

Most existing agentic reinforcement learning methods assume single-session trajectories, where interaction proceeds within one continuously accumulated context.

SimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Models

Action-conditioned robot world models must respond precisely to robot trajectories while preserving realistic visual dynamics, yet learning both from heterogeneous robot videos remains challenging.

Can World and Action Modeling Benefit Each Other under Unified Causal Training?

World and action modeling are closely related, yet their reciprocal benefits under unified causal training remain unclear.

MLExpert: Towards a Generalist Agentic Model for Autonomous Machine Learning Engineering

Large language models (LLMs) are expanding from assisting scientific research and engineering to autonomously developing and improving AI systems, advancing AI for AI (AI4AI) as a pathway toward recursive self-improvement (RSI).

Granite Switch 4.1: Chat, Decisions, and Speech from One Endpoint