📄 Notable* Recent AI/ML arXiv Papers

Last updated just now...

📄 Suppressing Misaligned Behaviors in Language Models, Durably
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.05358v1
👥 Authors: Luxi He, Pengcheng Jiang, Jifan Zhang, Jiawei Han (possible past Google (United States) affiliation), Danqi Chen (possible past Stanford University affiliation)
Abstract

Undesired model behaviors can emerge or re-emerge at any stage of training. Once observed, how effectively can we suppress them? To study this question, we first construct two model organisms--language models deliberately trained to exhibit a specific misalignment--that differ in what triggers the behavior. The narrow-trigger organism misbehaves only when the prompt contains a specific cue: it cheats on multiple-choice questions by following a planted hint that points to a wrong answer, and beha...

📄 You don't need long context
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.05306v1
👥 Authors: Peter Belcak, Saurav Muralidharan, Jindong Jiang, Yonggan Fu, Wonmin Byeon (possible past Nvidia (United States) affiliation), Hanrong Ye, Ryan Angilly, Ali Taghibakhshi, Shih-Yang Liu, Siru Ouyang, Greg Heinrich, Pavlo Molchanov (possible past Nvidia (United States) affiliation)
Abstract

Later tokens are costlier to generate than earlier tokens. On frontier open weight models, the disparity in cost may rise to as much as 7x. Through frequent compaction, we show across a broad range of long-horizon and long-input tasks that frontier language models sacrifice little to no task accuracy when maintaining short contexts. We further demonstrate that LLM performance does not collapse on long-horizon software engineering tasks even when taking at most one action per context, and based o...

📄 Fairness Metrics based on the AUC in Clinical Predictive AI
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.05222v1
👥 Authors: João Matos, Ben Van Calster, Richard D. Riley, Paula Dhiman (possible past University Of Oxford affiliation), Gary S. Collins (possible past University Of Oxford affiliation)
Abstract

Fairness evaluation of clinical prediction models for binary outcomes often involves fairness metrics that compare the area under the receiver operating characteristic curve (AUC, or c-statistic) across subgroups. However, the AUC has been shown to be a non-collapsible metric, meaning that its subgroup specific and overall values are not directly comparable as often implicitly assumed. This raises important questions about how existing AUC-based fairness metrics should be used and interpreted. W...

📄 LatentTriad: Pre-Action Risk Representations for Malicious Agent Skill Detection
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.05088v1
👥 Authors: Zhe Yu, Yi Liu (possible past Google (United States) affiliation), Ying Zhang (possible past Tencent (China) affiliation), Simin Chen
Abstract

Large language model agents are increasingly extended with reusable skills, but untrusted skill content can induce operations outside the user's task. Detecting this contextual risk requires more than suspicious-pattern matching, while dynamic analysis incurs the cost of skill execution. We find that hidden states formed during prefill contain readable information about task-operation consistency, including across held-out expression forms in controlled evaluations. Matched Operation-state inter...

📄 RGB Photo Enhancement with Deep Learning on Smartphone GPUs: Mobile AI 2026 Challenge Report
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.05024v1
👥 Authors: Andrey Ignatov (possible past Eth Zurich affiliation), Georgy Perevozchikov, Radu Timofte (possible past Eth Zurich affiliation), Dong Zhang (possible past Nvidia (United States) affiliation), Zhao Ran, Yang Zhang (possible past Tsinghua University affiliation), Xiaochen Li, Shichang Ju, Yiqin Cao, Yang Lu (possible past Meta (United States) affiliation), Nguyen Nhu Tinh Anh, To Thanh Dat, Nguyen Ngoc Ky Duyen, Nguyen Trong Nghia, Bui Minh Hieu, Qiuhai Yan, Sunzhe Yang, Kang Chen, Tingting Wang, Faming Fang, Runhua Deng, Zhifeng Wang, Long Peng, Aiwen Jiang
Abstract

On-device RGB photo enhancement is a popular task that is needed for quality improvement of photos captured with mobile devices as well as for retouching of images acquired through other sources. This creates a need for efficient deep learning models for this problem that are not only performant but can also be deployed on constrained mobile hardware. In this Mobile AI challenge, we address this problem and propose participants to design fast solutions that can perform comprehensive enhancement ...

📄 Learned Smartphone ISP on Mobile GPUs: Mobile AI 2026 Challenge Report
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.05008v1
👥 Authors: Andrey Ignatov (possible past Eth Zurich affiliation), Georgy Perevozchikov, Radu Timofte (possible past Eth Zurich affiliation), Yuhong He, Yuxuan Qiu, Tianyu Hao, Ruoqi Li, Yueqi Yang, Chaoyu Feng, Dongqing Zou, Lei Lei, Na Jiang, Yongrui Zhang, Hailong Yan, Xiangtao Zhang, Ao Li, Le Zhang, Andrei Arhire, Jing Fang, Xinglin Xie, Yichen Lu, Haibo Xu
Abstract

With the increasing importance of mobile camera quality in modern smartphones, growing attention has been directed toward computational photography and advanced image signal processing (ISP) algorithms aimed at enhancing various perceptual attributes of captured images. This creates a need for efficient deep learning models for this problem that are not only performant but can also be deployed on constrained mobile hardware. In this Mobile AI challenge, we address this problem and propose the pa...

📄 ScamWorld: An Interactive Environment for Evaluating Web Agents Against Online Fraud
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04879v1
👥 Authors: Yutao Wu, Xiao Liu (possible past Baidu (China) affiliation), Ming Wen, Hanxun Huang, Jun Wang (possible past Tencent (China) affiliation), Xingjun Ma
Abstract

Web agents increasingly browse, shop, and manage accounts on behalf of their users. Prior work has shown that they can be misled by adversarial content, including prompt injections and deceptive interfaces. Beyond such attacks, agents operating on the open web also encounter online fraud designed to deceive humans, including fraudulent online stores, fake investment platforms, and advance-fee schemes. How web agents respond to such fraud during task execution remains underexplored, in part becau...

📄 Feeling of Knowing in Large Language Models
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04834v1
👥 Authors: Zichuan Fu, Xian Wu (possible past Tencent (China) affiliation), Jingtong Gao, Wenlin Zhang, Jiaxuan Li, Binhao Wang, Yimin Deng, Guojing Li, Xiaopeng Li, Derong Xu, Yefeng Zheng (possible past Tencent (China) affiliation), Xiangyu Zhao
Abstract

Post-training updates change what large language models (LLMs) can answer, but may leave their answerability judgments misaligned. We study this knowledge-judgment desynchronization through functional feeling of knowing (FoK), which supports selective generation, retrieval triggering, and model routing without implying subjective experience. We propose two trainable channels: a knowledge channel that changes answerability and a FoK channel that judges the current knowledge state. Three stages tr...

📄 UniFlow: Unified Multi-Scale Flow Matching for Time Series Generation
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04825v1
👥 Authors: Shibo Feng, Wei Li (possible past Peking University affiliation), Min Wu, Chunyan Miao, Peilin Zhao (possible past Tencent (China) affiliation)
Abstract

Real-world time series exhibit complex dynamics across multiple temporal resolutions, yet effectively incorporating multi-scale information into generative modeling remains challenging without increasing generative complexity. We propose UniFlow, a unified framework that integrates multi-scale representation learning with efficient non-autoregressive generation through a shared-semantic discrete interface. Specifically, a multi-scale tokenizer employs shared-index voting to consolidate complemen...

📄 Think Less, Locally: Local Preference Learning for Reasoning Compression
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04814v1
👥 Authors: Muyao Yuan, Liyan Xu, Weizhan Zhang, Muyan Jiao, Jiangnan Li, Jinchao Zhang (possible past Tencent (China) affiliation), Jie Zhou (possible past Tsinghua University affiliation)
Abstract

Large reasoning models achieve strong performance on challenging tasks, but their long chain-of-thought often incurs substantial inference costs by continuing to deliberate after sufficient information has been obtained. Existing reasoning compression methods primarily operate on reasoning trajectories, paying less attention to the local decision of whether further reasoning is necessary given the current state. We propose LoCo, a local preference learning method for reasoning compression. LoCo ...

📄 Cycle WAM: Coupling Action and Video through Cycle Consistency
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04711v1
👥 Authors: Qinglin Yang, Jiepeng Wang, Yuxing Huang, Haibin Huang, Kai Xu (possible past National University Of Defense Technology affiliation), Chi Zhang (possible past Peking University affiliation), Ruizhen Hu, Xuelong Li (possible past Tencent (China) affiliation)
Abstract

Recent advances in video modeling have driven substantial progress in world action models (WAMs). Existing approaches exploit pretrained video priors by decoding actions from latent representations or inferring them from generated videos. The underlying link is causal: robot actions produce changes in the scene, and video observations of these changes provide evidence for inferring the actions that produced them. However, existing training formulations do not by themselves ensure that actions an...

📄 Uncertainty-Aware Prototype Learning for Open-Set Test-Time Adaptation
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04689v1
👥 Authors: Jinwu Hu, Langyu Bian, Jian Sun (possible past Microsoft (United States) affiliation), Dongjin Yang, Chao Shuai, Yufeng Wang, Kai Zhou, Bin Xiao (possible past Microsoft (United States) affiliation), Mingkui Tan (possible past Baidu (China) affiliation), Hongmin Cai, Wei Luo (possible past Baidu (China) affiliation)
Abstract

Open-set test-time adaptation (TTA) aims to adapt source-trained models to unlabeled test streams where covariate-shifted in-distribution (csID) samples and covariate-shifted out-of-distribution (csOOD) samples may coexist. Existing TTA methods are typically designed under a closed-set assumption and therefore lack explicit mechanisms for reliably distinguishing csID from csOOD samples. Consequently, csOOD samples may be mistakenly included in confidence-enhancing adaptation, producing harmful g...

📄 Inter-Agent Influence: Evaluating Persuasion, Deception, and Coercion in Multi-Agent Systems
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04556v1
👥 Authors: Chandler Smith, Qi Guo, Cecilia Elena Tilli, Sophia Hatz, David Demitri Africa, Patricia Paskov, Christian Schroeder De Witt (possible past University Of Oxford affiliation), Philip Torr (possible past University Of Oxford affiliation), Lewis Hammond
Abstract

The deployment of AI agents in multi-agent settings enables inter-agent influence, whereby agents can strategically steer each other's behaviour towards an intended outcome. Such capabilities pose novel risks, as malicious agents could direct others towards harmful actions. In this work we investigate three such capabilities - persuasion, deception, and coercion - across five realistic evaluation environments and a variety of agents instantiated with frontier language models. We observed signifi...

📄 CANDO: Conservative Action-Noise Directional Optimization for Residual Reinforcement Learning
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04543v1
👥 Authors: Zeyu Gao, Chengkai Hou, Chaoyue Li, Zhuangzhe Wu, Jiaming Liu (possible past Baidu (China) affiliation), Yao Mu, Peng Jia, Li Zhang (possible past University Of Oxford affiliation), Shanghang Zhang
Abstract

Pretrained generative policies provide strong behavior priors for robot control, but adapting them efficiently with online reinforcement learning remains difficult. A central challenge is how to improve a frozen generative policy without destroying the structure learned from offline demonstrations. Noise-space residual methods address this by modifying the policy's input noise, but existing noise-space methods typically regulate adaptation through fixed latent feasible regions, which may exclude...

📄 Large Language Model-Assisted Adaptive Heuristic Search for Agile Earth Observation Satellite Scheduling
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04458v1
👥 Authors: He Wang (possible past Stanford University affiliation), Yeye Liu, Ruijie Li, Xuemei Jiang, Junyu Wu, Lining Liu Zhuoqi Man, Tao Li (possible past Baidu (China) affiliation), Yanjie Song
Abstract

Agile Earth observation satellites must coordinate imaging tasks within limited observation windows, while accounting for attitude maneuvering and onboard energy constraints. Competition among observation opportunities makes scheduling performance sensitive to the heuristic rules used for task selection. This letter proposes a large language model (LLM)-assisted adaptive heuristic search method for agile Earth observation satellite scheduling. The LLM generates an initial heuristic rule accordin...

📄 Planning-Coding Separation in LLM-Based Code Generation: An Empirical Study
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04320v1
👥 Authors: Wentao Wang (possible past Baidu (China) affiliation), Zeyu Sun (possible past Peking University affiliation), Ruwei Pan, Yueyi Xiao, Qingyuan Liang, Lu Zhang (possible past Tencent (China) affiliation)
Abstract

Planning has been identified as an important factor for improved code generation with Large Language Models (LLMs). However, the interaction between planning capability and coding capability remains largely underexplored, especially when the two capabilities are from different LLMs. In this paper, we conduct the first comprehensive empirical study of planning-coding interaction in LLM-based code generation, where planning and coding are assigned to different LLMs (i.e., planning-coding separatio...

📄 OSGR: Observation-Support Graph Reasoning for Earth Observation Question Answering
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04301v1
👥 Authors: Dazhou Yu, Zerong Wang, Riyang Bao, Longxiang Li, Yang Liu (possible past Tsinghua University affiliation), Liang Zhao (possible past Baidu (China) affiliation)
Abstract

Answering geographic queries over Earth observation (EO) archives requires solving a joint retrieval-and-derivation problem under strict spatiotemporal constraints. Existing LLM agents fail to ground observation items or suffer from search-space explosion. We propose OSGR, a two-stage framework that factorizes this search into offline symbolic concept deduction and online Relation-Conditioned Grounding. OSGR leverages an offline Observation-Support Graph to deduce valid target-to-result support ...

📄 Harness-S: Learning from Sibling Harnesses for Generalizable Agent Training
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04277v1
👥 Authors: Kangning Zhang, Wenxiang Jiao, Bowen Fang, Shuai Shao, Jiachen Zhu, Rong Shan, Shijian Wang, Hao Wang (possible past Tsinghua University affiliation), Yuan Lu, Weiwen Liu, Weinan Zhang (possible past Shanghai Jiao Tong University affiliation)
Abstract

Harness evolution from a common base exhibits Locality, Complementarity, and Nonstationarity: variants repair different failures, and their utility changes as the policy learns. Rather than seeking a universally superior harness, we introduce Harness-S to selectively rescue failures of a base execution system through sibling harnesses and transfer the resulting capabilities into a single policy that remains effective under the original harness. Directional Harness Evolution develops specialized ...

📄 Toward User-Centered Agentic Recommendation: When Does Platform Competition Benefit Users?
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04203v1
👥 Authors: Kehan Zheng, Deyao Hong, Qian Li (possible past National University Of Defense Technology affiliation), Jun Zhang (possible past Tencent (China) affiliation), Jie Jiang (possible past Tencent (China) affiliation), Hongning Wang
Abstract

Conventional recommender systems operate within platform-specific catalogs, limiting access to potentially valuable resources across platforms. We propose user-centered agentic recommendation, a paradigm in which user agents compare recommendations from competing platform agents, and formalize their interaction as a repeated game. Platforms strategically modify descriptions without changing intrinsic item value, while each user agent assesses platform credibility using feedback from consumed ite...

📄 Agentic Path Maps: Exposing an Agent's Traversal Through the Garden of Forking Paths
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04183v1
👥 Authors: Madeleine Grunde-Mclaughlin, Hafsah Usman, Daniel Mitroshkov, Emily Reif (possible past Google (United States) affiliation), Nino Migineishvili, Lakshya Chauhan. Kevin Yu, Jeffrey Heer (possible past University Of Washington affiliation), Daniel S. Weld (possible past University Of Washington affiliation)
Abstract

When an AI agent executes an underspecified task, it embeds choices that may contradict unarticulated user context and preferences. However, interrupting the user for clarification on all such decisions is untenable. How might agents communicate impactful, but unexplored, paths to the user after execution? To investigate, we first distill a design space for communicating alternative paths, supporting the generation of new systems and structuring dimensions of future study. We then measure the im...

📄 What Remains in Sight? Autoregressive Video Decoding as Representation-Guided Context Rewriting
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04164v1
👥 Authors: Lixuan He, Jihyeon Je, Yang You (possible past University Of California, Berkeley affiliation), Leonidas Guibas (possible past Stanford University affiliation)
Abstract

Long-horizon video generation is increasingly moving toward autoregressive rollout, where each newly generated segment becomes part of the evidence used for future prediction. Recent causal decoders, long-context training, and KV-cache mechanisms have extended feasible duration, but most inference pipelines still decide the visible past implicitly through recent windows, compressed caches, or external memory. This raises a direct question: \textbf{can the choice of which past frames or segments ...

📄 ScienceVision: Can AI Observe and Reason Like a Scientist?
🗓️ Published: 11/2/2026
🔗 http://arxiv.org/abs/2611.04087v1
👥 Authors: Tianyi Ma, Jing Gu, Haozhe Zhao, Liang Chen (possible past Google (United States) affiliation), Yunfan Zhang, Haijun Su, Jialong Wu, Le Xue, Arnav Das, Dustin Tran (possible past Google (United States) affiliation), Yinfei Yang (possible past Google (United States) affiliation), Andrew Dai, Kuan Li
Abstract

Scientific discovery builds on accurate observations interpreted through domain knowledge and reasoning. For scientific 3D data, this requires understanding structures and spatial relationships, from protein contacts to anatomical organization. Existing multimodal benchmarks largely evaluate text and 2D images, while scientific 3D evaluations vary in representations and protocols across disciplines, limiting cross-disciplinary comparison. To assess these foundational capabilities, we introduce S...

📄 WASP-Mem: Let Agent Organize Procedural Memory. Human Spend Effort on Diagnosis
🗓️ Published: 11/2/2026
🔗 http://arxiv.org/abs/2611.04003v1
👥 Authors: Peizhi Niu, Ge Shi, Vaibhav Gorde, Sarthak Ghosh, Christos Faloutsos (possible past Carnegie Mellon University affiliation), Min Cheng, Kevin Chen (possible past University Of California, Berkeley affiliation)
Abstract

LLM agents struggle to automate complex enterprise procedures because static, pre-built harness cannot capture proprietary policies, undocumented behaviors, or state-dependent recovery paths that surface only during execution. Procedural memory accrued from agent experience offers a training-free path to closing this gap -- yet unlike episodic records or semantic facts, it must consolidate repeated successes and diagnosed failures into reusable actions and recovery strategies. We introduce WASP-...

📄 FlagRot: Selective Rotation for Low-Bit KV Caches
🗓️ Published: 11/2/2026
🔗 http://arxiv.org/abs/2611.03992v1
👥 Authors: Kunming Shao, Xijie Huang, Jierun Chen, Jiaqi Shao, Yanli Wang, Jiangnan Yu, Qiwei Li (possible past Tsinghua University affiliation), Wei Zhang (possible past Tsinghua University affiliation), Kwang-Ting Cheng, Chi Ying Tsui
Abstract

Long-context inference is bound by the KV cache, which 2-bit codes could shrink about sixfold if their error stays in check. The usual remedy rotates keys before quantizing, assuming rotation always helps. However, we observe that it does not: rotation flattens a spiky piece of a key but can give a flat one a new peak, and both coexist within one key. We therefore propose FlagRot, which stores each 32-channel piece rotated or as is, whichever has the smaller calibrated attention error, and rotat...

📄 SLATE: A Large-Scale Benchmark for Long-Horizon API Selection in E-commerce Tool Use
🗓️ Published: 11/2/2026
🔗 http://arxiv.org/abs/2611.03982v1
👥 Authors: Rongzhe Wei, Ge Shi, Min Cheng, Sarthak Ghosh, Vaibhav Gorde, Leman Akoglu (possible past Carnegie Mellon University affiliation), Pan Li (possible past Baidu (China) affiliation), Na Zhang
Abstract

Enterprises increasingly want LLM agents to automate standard operating procedures over their software stacks -- mapping each step of a procedure to the right call among thousands of internal APIs, without hand-authored step-to-API mappings. The core difficulty is API selection at scale: choosing and composing the correct tools over a long horizon, judged only by whether the overall task succeeds. Current tool-use benchmarks do not test this regime -- they expose only a handful of tools, evaluat...

📄 ProteoCraft: Protein Design as Proposal-Verification Search
🗓️ Published: 11/2/2026
🔗 http://arxiv.org/abs/2611.03963v1
👥 Authors: Fang Wu, Hongbin Lin, Bingchen Duan, Yuchen Wang, Li Erran Li, Yanjie Huang, Mingxuan Cao, Yijun Ma, Yunxiang Mo, Yanchao Li, Kuan Pang, Juangui Xu, Hanqun Cao, Dongwei Jiang, Xinyue Xu, Xiangru Tang (possible past University Of Cambridge affiliation), Zehong Wang, Jian Ma, Kejun Ying, Guanlue Li, Mingran Cao, Fanjin Wang, Tianfan Fu, Shuangjia Zheng, Yao Shu, Jure Leskovec (possible past Stanford University affiliation), Yejin Choi (possible past Allen Institute For Artificial Intelligence affiliation)
Abstract

Protein-protein interactions underpin nearly all biological processes. Yet, designing proteins with desired interactions remains challenging due to the structural complexity governing molecular recognition. This study views protein design as a search optimization problem over a combinatorial sequence space under expensive structural evaluation. Toward this goal, we introduce a novel tree-based search framework, ProteoCraft, that employs approximate structural gradients from diffusion-based struc...

📄 Stabilizing On-Policy Targeted Guidance in Agentic Reinforcement Learning
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.05266v1
👥 Authors: Kevin Frans, Alexander M Rush, Sergey Levine (possible past University Of Washington affiliation), Pieter Abbeel (possible past University Of California, Berkeley affiliation), Ashvin Nair (possible past University Of California, Berkeley affiliation)
Abstract

Naive on-policy RL is often bottlenecked by the capabilities of the base model --- insufficient coverage can result in an inability to learn from certain rewards. At the same time, rewards in modern post-training systems often come from rich textual sources, e.g. judge models with a rubric of criteria. Can we utilize such structures to provide a rich directional signal that enables improving on otherwise difficult to optimize rewards? In this work, we examine a framework we refer to as targeted ...

📄 Curriculum unlearning in humans and neural networks
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04565v1
👥 Authors: Jirko Rubruck, Alice Zhang, Andrew Saxe (possible past University Of Oxford affiliation), Christopher Summerfield (possible past University Of Oxford affiliation)
Abstract

During learning, humans often benefit from curricula that teach simple rules before exceptions. However, we lack a computational explanation for this phenomenon. Here, using a canonical behavioural task and modelling with neural networks, we develop and test a theory for why simple-to-complex curricula succeed. We show that during learning, both humans and neural networks show simplicity biases, a tendency to learn simple rules that are underfit to the data. In neural networks this bias is accom...

📄 Say the Same, Act Differently: Diagnosing and Steering Text-Action Divergence in Reasoning VLAs
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04166v1
👥 Authors: Zihao Feng, Qingzhao Zhang, Chunyu Xia, Bo Yu (possible past Baidu (China) affiliation), Z. Morley Mao, Ramesh Govindan (possible past Google (United States) affiliation)
Abstract

Reasoning vision-language-action (VLA) models pair physical control with natural-language rationales that supervisors can read to monitor embodied safety. Prior attacks on VLA reasoning corrupt the rationale itself and leave visible evidence in the text. We show that visual perturbations can instead alter the physical action while keeping the generated rationale word-for-word identical. At the shared text/action interface of Alpamayo for driving and InstructVLA for manipulation, our text-neutral...

📄 ModelBlaster: Closing the Performance Gap through Learning-Augmented Agents Across Models, Kernels and Hardware Backends
🗓️ Published: 11/3/2026
🔗 http://arxiv.org/abs/2611.04104v1
👥 Authors: Shengjun Kris Dong, Dima Nikiforov, Sahil Modi, Sana Damani, Edward C Lin, Siva Kumar Sastry Hari (possible past Nvidia (United States) affiliation), Christos Kozyrakis (possible past Stanford University affiliation)
Abstract

Optimizing accelerator code across hardware architectures is difficult. ML compilers search predefined spaces of schedules and micro-kernels, while LLM-guided optimization can explore alternative algorithms, operator decompositions, and hardware-specific techniques. However, existing LLM agents typically target a single programming interface, toolchain, or accelerator family, focus on kernel-level optimization without model-level transforms, and offer limited reuse of experience across hardware ...

*Notable papers are those with at least two authors from a "big" AI/ML lab.