πŸ“„ Notable* Recent AI/ML arXiv Papers

Last updated just now...

πŸ“„ Continual Learning Exam: Benchmarking Long-Horizon RSI and Experiential Learning in LLM Agents
πŸ—“οΈ Published: 10/25/2026
πŸ”— http://arxiv.org/abs/2610.33956v1
πŸ‘₯ Authors: Haoyu Zhao, Sitian Tu, Yuxuan Huang, Huichi Zhou, Zhangyue Yin, Jiahao Huang, Jingyuan Xu, Tianmiao Shi, Jin Shi, Nianxi Zhang, Yangmiao Zhang, Zhuolang Chan, Huiyan Hu, Chenchao Sheng, Yaqing Luo, Yue Chen (possible past Google (United States) affiliation), Huaxiu Yao, Meng Fang (possible past Tencent (China) affiliation), Jun Wang (possible past Tencent (China) affiliation)
Abstract

Continual learning is the ability of LLM agents to improve over time by acquiring, refining, and applying knowledge from experience while retaining useful prior knowledge. It is essential for agents learning over long time horizons, yet current evaluations largely assess individual task performance rather than improvement through accumulated experience. We introduce Continual Learning Exam (CLE), a large-scale benchmark developed by 50+ domain experts to measure experience-driven improvement in ...

πŸ“„ OS-Wizard: Scaling Computer-Using Agents to Specialized Software via Knowledge-Guided Exploration
πŸ—“οΈ Published: 10/24/2026
πŸ”— http://arxiv.org/abs/2610.33907v1
πŸ‘₯ Authors: Zhoumianze Liu, Zichen Ding, Bowen Yang, Zehao Li, Zhenyu Wu, Yibo Zhao, Kanzhi Chen, Yian Wang, Yanan Sun (possible past Tencent (China) affiliation), Qiushi Sun, Yu Qiao (possible past Shanghai Artificial Intelligence Laboratory affiliation)
Abstract

Computer-using agents are increasingly capable of performing complex tasks in the digital world. However, high-quality interaction trajectories remain scarce for specialized desktop applications, where limited application knowledge, cumbersome GUI workflows, and incomplete exploration hinder automated collection. We introduce OS-Wizard, an automated trajectory collection framework. It combines tutorial-guided exploration with a hybrid GUI--Code action space, providing application-specific knowle...

πŸ“„ RoboReason: Boosting Robotics-Relevant VLM Reasoning Through Scalable Data Generation
πŸ—“οΈ Published: 10/24/2026
πŸ”— http://arxiv.org/abs/2610.33778v1
πŸ‘₯ Authors: Sagnik Anupam, Utkarsh Lal, Aneesh Edara, Botong Zhang, Yao Tang, Jiatao Gu (possible past Meta (United States) affiliation), Dinesh Jayaraman (possible past University Of California, Berkeley affiliation), Osbert Bastani
Abstract

Vision-Language Models (VLMs) have demonstrated impressive performance when integrated into robot manipulation pipelines, but real-world evaluation of VLM capabilities on downstream robotics tasks is both difficult and expensive to scale. We propose that spatial and temporal ordering tasks using images from stereo and wrist cameras attached to real-world robots are particularly well-suited for evaluating visual reasoning capabilities, as they assess skills directly applicable to robots. We evalu...

πŸ“„ A Distribution-Matching Perspective on LLM Training Algorithms
πŸ—“οΈ Published: 10/24/2026
πŸ”— http://arxiv.org/abs/2610.33740v1
πŸ‘₯ Authors: Yanxing Huang, Bingzhang Yan, Zihan Tang, Wenzhe Li, Peng Li (possible past Tsinghua University affiliation), Yang Liu (possible past Tsinghua University affiliation)
Abstract

In this work, we propose a unified framework for training algorithms across different stages of modern large language model development, based on the perspective of distribution matching. We show that a broad class of language model training algorithms can be interpreted as minimizing a certain divergence between the current model and a target distribution, and that characterizing the properties of this target distribution provides substantial insight into the behavior of the corresponding train...

πŸ“„ Replicate What Varies: Resource Sharing for Domain-Randomized Embodied Simulation
πŸ—“οΈ Published: 10/24/2026
πŸ”— http://arxiv.org/abs/2610.33582v1
πŸ‘₯ Authors: Zixu Hao, Weijun Wang (possible past Google (United States) affiliation), Xiangyu Li, Liang Mi, Hao Wu (possible past Tencent (China) affiliation), Yunxin Liu, Ting Cao
Abstract

Simulation provides a low-cost sandbox where embodied agents can attempt tasks, observe outcomes, and learn from experience. Running many diverse simulation environments concurrently can consume substantial CPU and GPU memory because independently constructed scenes duplicate resources that remain unchanged across instances. We present Patchwork, a resource-sharing system for domain-randomized simulation, built around the representation $E=T+Ξ”$: a shared template contains common resources, and a...

πŸ“„ AdaPRA: Process Reward Agents with Adaptive Rubrics for Data Science
πŸ—“οΈ Published: 10/23/2026
πŸ”— http://arxiv.org/abs/2610.33245v1
πŸ‘₯ Authors: Atharva Naik, Vivek Chari, Pol Llado, Daniel Fried, Carolyn RosΓ©, Benjamin Van Durme (possible past Google (United States) affiliation), Sam Thomson (possible past Google (United States) affiliation), Justin Svegliato
Abstract

Data science agents can automate end-to-end machine learning workflows, yet they remain far from competitive on human leaderboards. Agents make process errors such as insufficient exploration, unsound validation, coding bugs, and poor use of a fixed budget (re-running the same exploratory data analysis and baseline models in every attempt). We propose AdaPRA to address these issues: a persistent coding agent harness that accumulates knowledge across attempts on the same task, with rubric-guided ...

πŸ“„ Semantic Representation for Agentic Self-Play in Automated Laboratories
πŸ—“οΈ Published: 10/23/2026
πŸ”— http://arxiv.org/abs/2610.32755v1
πŸ‘₯ Authors: Yves Delley, John Coller, Zachary Cutts, Alexander Daryin, Mathias Bellaiche, Jun W. Kim, Oscar Donosa, Srinidhi B. Seshadri, Tanner Clary, Sandy Klemm, Avinatan Hassidim (possible past Google (United States) affiliation), Yossi Matias (possible past Google (United States) affiliation), Pooja Rao, Petar Sirkovic, Annalisa Pawlosky (possible past Google (United States) affiliation)
Abstract

Navigating complex, high-dimensional biological search spaces necessitates scalable physical and computational intelligence to explore beyond local optima through iterative self-play across ideation, experimentation, and automation. Translating experimental designs into reliable physical execution remains bottlenecked by static laboratory automation and unmodeled physical variability. To address this, we introduce VERified Infrastructure for Discovery Laboratories, or VERID, a foundational infra...

πŸ“„ When Agents Fail: Model or Harness--Who's to Blame?
πŸ—“οΈ Published: 10/23/2026
πŸ”— http://arxiv.org/abs/2610.32483v1
πŸ‘₯ Authors: Shao Zhang, Hangfan Zhang, Yuanyuan Shi, Hao Li (possible past Tsinghua University affiliation), Min-Le Su, Kangcong Li, Jingping Wang, Chunjiang Mu, Chen Zhang (possible past Peking University affiliation), Yang Chen (possible past Tencent (China) affiliation), Bo Zhang (possible past Tencent (China) affiliation), Shuyue Hu
Abstract

LLM agents combine models with execution harnesses, so agentic benchmark performance reflects their joint behavior. We argue that harnesses should therefore be evaluated through their interactions with underlying models. We develop a framework combining five complementary measures: (i) Valid Completion Rate (VCR), how reliably agents finish normally and deliver evaluable results, irrespective of task correctness; (ii) Model-Harness Fit, how well a harness supports task achievement through valid ...

πŸ“„ FG-ConvNO: A Geometry-Aware Neural Operator for Propeller CFD Prediction
πŸ—“οΈ Published: 10/24/2026
πŸ”— http://arxiv.org/abs/2610.33456v1
πŸ‘₯ Authors: Yichen Di, Valentin Duruisseaux, Di Zhou, Xinyi Li, Daniel Leibovici, Jean Kossaifi (possible past Nvidia (United States) affiliation), Anima Anandkumar (possible past Nvidia (United States) affiliation)
Abstract

Computational Fluid Dynamics (CFD) is essential in contemporary engineering design, yet it remains expensive to compute and can take thousands of CPU/GPU hours or more for a single high-fidelity simulation. Recent developments in machine learning for scientific modeling have led to powerful surrogate frameworks that can approximate flow fields and physical quantities by using a fraction of the computational cost. However, most of these methods require largescale homogeneous datasets or simple ge...

πŸ“„ From Intelligence to Autonomy: Foundations and Construction of Autonomous Agents for Future Intelligent Systems
πŸ—“οΈ Published: 10/24/2026
πŸ”— http://arxiv.org/abs/2610.33445v1
πŸ‘₯ Authors: Hongda Zhang, Ziqing Zhou, Yuning Chen, Linqiang Hu, Yi Liu (possible past Google (United States) affiliation), Ding Zhou (possible past Meta (United States) affiliation), Zhao Huang, Haining Xu
Abstract

Artificial intelligence is moving from one-off perception and generation tasks toward long-term planning, tool use, and interaction with real environments. Greater task competence, however, does not automatically yield autonomy: an external actor may still have to set goals, sustain operating conditions, detect failures, and approve updates. We define an autonomous agent as a system that, within explicit identity and authority boundaries, maintains both task goals and viability conditions, acts ...

πŸ“„ An Empirical Study of Reinforcement Learning Scaling Laws
πŸ—“οΈ Published: 10/24/2026
πŸ”— http://arxiv.org/abs/2610.33420v1
πŸ‘₯ Authors: Zeyu Zheng, Clare Lyle, Khimya Khetarpal (possible past Deepmind (United Kingdom) affiliation), Will Dabney (possible past Google (United States) affiliation)
Abstract

The discovery of scaling laws enables prediction of the performance, the optimal resource allocation strategy, and the best hyperparameter configuration of a large-scale training job based on inexpensive experiments at smaller scales. Guided by these empirical scaling laws, the deep learning community has achieved great success in training large (self-)supervised models on Internet-scale datasets. In contrast, despite its potential and wide application, reinforcement learning (RL) has yet to fin...

πŸ“„ MLIPDiff: Guiding Denoising Diffusion Models for Structure-Based Drug Design via Machine-Learned Interatomic Potentials
πŸ—“οΈ Published: 10/23/2026
πŸ”— http://arxiv.org/abs/2610.33315v1
πŸ‘₯ Authors: Yiyan Liao, Amin Tavakoli, Yu Zhang (possible past Google (United States) affiliation), Anima Anandkumar (possible past Nvidia (United States) affiliation)
Abstract

Diffusion models have become a dominant approach to structure-based drug design. However, because they are trained primarily to fit reference structures, they often place ligands in physically implausible poses that clash with the protein. We introduce MLIPDiff, an inference-time guidance method that can be applied to pretrained diffusion models for ligand generation. The method uses physics-informed guidance from UMA (Universal Models for Atoms), a machine-learned interatomic potential (MLIP). ...

*Notable papers are those with at least two authors from a "big" AI/ML lab.