Recent research advances LLM efficiency, with System X reducing latency by 15-39% and LoGIST improving logical invariance, while StopLoss cuts coding costs by 31%. Agentic reliability is enhanced through context compaction, native grammar editing, and symbolic constraints, though some methods face latency or hidden shortcut issues. Domain-specific tools include quantum-inspired federated learning, clinical trajectory modeling, and legal RAG optimization. Safety and evaluation reveal LLMs prone to goal displacement, over-trust in internal records, and procedural hallucinations, with interventions like EVIGATE and structured-data-first agendas mitigating risks.
Planning and reasoning improvements include test-time search boosting accuracy by 15x, geometric early exits, and counterfactual verification. New benchmarks expose gaps in generalization, geometry handling, and novel intervention responses. Architectural studies show deterministic methods outperform LLMs for arithmetic, while transformers exhibit conditional forgetting. Specialized applications span rare disease diagnosis, financial auditing, and embodied planning, often balancing accuracy with computational constraints. Clinical causal KGs show weak text-mined signals, and agents benefit from ID-TAP personalization, Recursia robot manipulation gains of 40 points, Hippo memory adaptation, and SELM skill management.
Limitations persist in habit induction with 33.61% accuracy and physics reasoning drift. New methods include RLAWM gaining 12.2 points, M²Net forecasting, Dynamic State Filtering EEG, HSPR evaluation, CADS biological screening, and confidence-thresholded membership inference. Agent capabilities vary: legal AI drafts limited constitutions, meteorological downscaling improves with physics operators, human reasoning references often err, LLM agents struggle with complaints but improve post-training, inhibitory messaging boosts multi-agent efficiency, ReTRACE plans syntheses, and no single prompting technique dominates. Reasoning and safety tools include HybridResearcher, One-relation attacks exposing implicit warrant vulnerabilities, CoworkEnv training synthesis, SteadyThought reducing tokens by 63.8%, and CorrectRTL raising Pass@1 to 49.0%.
Memory and efficiency systems feature MemPrice adaptive pricing, Medaka planning, Formal Raising ethics, and MELD recursive self-improvement. Evaluation benchmarks cover DKnown-Jev with 98.75% accuracy, multimodal alignment gaps, LogicVal T2I constraints, and VibeTraining-Bench improvements. Specific advances include RNDR-TFCA fault diagnosis, CODA clinical reasoning, TRACE-FIX recovery, BLM cost reduction of approximately 98%, and IF-MAP token savings of 74.2%. Digital medicine shifts to action via Population Health World Models, while decision-model controllers often fail calibration. Compact LLMs struggle with mobility recovery, and agent harnesses critically impact success. Robust POMDPs use law-invariant risk measures, and medical fine-tuning decouples factual correctness from safety.
Key Takeaways
- System X saves 15-39% latency; StopLoss reduces coding costs by 31%.
- LoGIST improves logical invariance in LLMs.
- Test-time search boosts accuracy by 15x.
- Deterministic methods outperform LLMs for arithmetic tasks.
- SteadyThought reduces token usage by 63.8%.
- CorrectRTL raises Pass@1 to 49.0%.
- BLM achieves approximately 98% cost reduction.
- IF-MAP saves 74.2% in tokens.
- CDNA clinical reasoning and TRACE-FIX recovery improve medical AI.
- No single prompting technique dominates agent performance.
Sources
- System X: An LLM Decision Model That Replies from Its Own KV Cache
- When Form Changes but Logic Doesn't: Building Logic-invariant LLMs through Logical Structure
- Aligning Language Models with Indigenous Community Cosmovision through Constitutional AI
- Bridging Concepts: Multi-Agent Reasoning over Scientific Concept Graphs for High-Impact Research Prediction
- From Proposal to Execution: Modeling Interaction Semantics in Shared Autonomy
- P(Yes): 15$\times$ Improvements via Test-Time Scaling of Decision Models
- A failure of Imagination: VLMs fail to use visual representations for text, but self-distillation can help
- On Reasoning Correctness Directions
- From Clinical Risk Prediction to Operational Decisions: An Uncertainty-Aware Framework for ICU Staffing
- StopLoss: Teaching Agents to Predict Failure and Stop Early
- When Empathy Misses the Goal: A Benchmark for Goal Displacement in LLM Advice
- Bud ContextCompact 2.0: Context Compaction for Agent Success and Accuracy with Small Language Models and Constrained Context Windows
- Editing as Language: Teaching LLM Agents a Grammar for Native Context Editing
- Auditing Tool Traces in Agentic LLMs: Source Localization and Counterfactual Dependence Testing
- The Forward/Inverse Duality of Controlled Emergence:A Computational Design Program from Explanation to Engineering
- Symbolic Constraint Agents: Mining Formal Tool-Call Constraints to Prevent Agent Errors
- HyperTaxa: Multiscale Genome Representations for Generalized Microbial Taxonomic Inference
- Think, Compress, Answer: Reinforcement Learning for Multimodal Grounding via Reasoning Compression
- When Safety Fails Collectively: Robust Alignment Against Harmful Fine-Tuning via Joint Weight Perturbations
- BitFlat: Error-Localized Bitstream Design for Robust Diffusion Image Compression
- CVaR-RMD: CVaR Selection Pressure for Robust Metaheuristic Discovery
- From Black Box to Controller: Inference-Time Steering of LLM via Feature Amplification
- Fine-Grained Units, Flat Decisions: Hierarchical Micro-Expert Pruning for Mixture-of-Experts Models
- PFedQFT: Personalized Federated Quantum-Inspired Fine-Tuning for Medical Large Language Models
- Whose Credential Is It? How Owner Attribution in Agent MemoryShapes Cross-User Account Misuse
- Standing on the Shoulders of Giants: Enhancing LLM Agents for Automated Fact-Checking with Human Expert Skills
- EvalRx: Agentic Diagnosis and Verified Repair of Foundation Models
- TRACE: Tracking Multimodal Clinical Trajectories for Inpatient Risk Prediction
- When to Stop Asking: Factor Coverage Bias and LLM Determinability Judgments with Underspecified Information in Medicine
- SAR: Learning Global Item-Space Matching and Geometry-Aware Placement Ranking for Buffered Online 3D Bin Packing
- Can LLM User-Proxies Stand In for Humans in Reliance Measurement? Replicating Rel-A.I. with Simulated Users
- A Cue's Hidden Price: Auditing Seller Influence on AI Shoppers
- FrontierRefactor: Benchmarking Multi-Scale Performance-Oriented Codebase Refactoring
- Benefit-Targeted Routing and Bounded Revision for LLM-Based Evidence Screening in Manufacturing Supplier Discovery
- Minimum-Cost Robust Evidence Certificates for Horn Reasoning under Correlated Source Failures
- Are Self-Evolving Agents Continual Learners?
- TESS: LLM-guided Translation, Exploration, Simulation, and Search for Embodied Task Planning
- When Should AI Chime In? Benchmarking Timely Contribution of Proactive Agents in Multi-Party Chat
- Claim Laundering: When Agent Decision Models Trust Records Over Reality
- Global probabilistic forecasting of air pollution
- EmbodiedWorld-200K: Toward Embodied World Agents via Embodied-Planning Dataset and Interactive World Models
- CXBench: A Benchmark for Process-Compliant LLM Agents in Regulated Customer-Experience Workflows
- ClueFlow: Learning Long-Horizon Search through Attributed Research-State Transitions
- GraphEvoResearcher: Graph-Aware Training-Free Self-Reflective Reasoning for Cost-Bounded Multi-Hop Question Answering
- On the Benefits of Uncertainty Estimation for Species Classification: A Case Study on Optimizing Expert re-Annotation
- GLOBE: Geometry-Led Online Behavioral Early Exit via Unit-Sphere Trajectories
- FinSafeGuard: A Quality-Driven Synthetic Dataset for Financial AI Safety
- AuDQ: Auditable Data Quality through Agentic Rule Discovery
- Understanding When Reflective Prompt and Skill Optimization Helps on Locally Served Reasoning Models: A Two-Model Study of GEPA and SkillOpt
- TimesJev: Thinking Fast on Time Series with System 1 Sufficiency
- Procedural Memory for Language Agents: A Neurosymbolic Perspective on Explicit Goal Structure
- On Counting Graphs for Modal Logic with Counting
- From Code to Playable Systems: CEGame-Bench for Long-Horizon Game Creation Agents
- CUA-Lite: An Open Platform for Computer Use Agents
- CoRS: Fast Neural Flexible Job-Shop Scheduling via Composite Interval State Reuse
- Towards More Granular Reasoning: Mapping the DSA Transparency Database Taxonomy to Platform Terms and Conditions Using Large Language Models
- Fairness or Fallacy? Mapping the Landscape of AI Bias in Disease Detection
- REFLEX: RNA Ensemble Generation via Flexibility-Calibrated Stochastic Bridge
- Beyond Static Leaderboards: Capability-Focused Evaluation with Structural Diversity for Time Series Foundation Models
- A Generic On-Board AI Processing Chain for Earth Observation: From Application Development to Embedded Deployment and Mission-Level Orchestration
- StrucChunk: Structure-Aware Retrieval for Legal Document RAG
- Selective Transfer through Sequence Distillation: From Benchmark Knowledge to Backdoor Behaviour
- From Outcomes to Components: A Counterfactual Evaluation Framework for LLM-Proposed Repairs
- Autonomous intelligence for mining productivity: a multi-agent AI approach to operational value creation
- GAIDA: Generative AI for Human-in-the-Loop Document Annotation
- Answer Delivery Under a Shared Token Budget: An Audited Study of Stopping and Finalization
- BOSS: Token-Budgeted Online Sampling and Selection for LLM Reasoning
- ScopeMem: Latent Memory That Learns Where to Revise Frozen GUI Agents
- VeriCUA: Learning Proactive Verification for Reliable GUI Agent Rewards
- Remembering Has a Price: Learning Memory Worth under Resource Constraints
- A Semantic Knowledge Graph Construction Pipeline for Vehicle Intention Prediction in nuScenes
- Beyond Behavioral Accuracy: Evaluating Individual-Level Fidelity in LLM Investor Simulation
- Toward Structured Financial Foundation Models
- Agentic Orchestration of EDC Data Space Retrieval and Natural Language Driven Data Processing
- WhatIf-Bench: Benchmarking Intervention-Aware Time Series Forecasting
- BetaMem: Learning to Remember a Changing World for Embodied Agents
- Training Natural Schemers: RL Can Amplify Oversight-Conditional Behavior
- Revision-Based Learning from Interactive Experience and Feedback
- Towards Robust Model Organisms for Eliciting Latent Knowledge
- StebBench: Diagnosing Real-World Procedural Understanding in AI Agents
- Honeypots for AI Agent Insider Threats
- AllPath: Layered Verification for a Deployed, Self-Revising LLM Trading Agent under Human-Gated and Autonomous Regimes
- Same Simulation, Different Evidence: Where Retrieved Tool Output Costs LLM Agents Accuracy
- Agent World Model in the Wild: Computer-Use Agent Environment Synthesis
- SOMA: Continuous Monitoring and Intervention for System Two Reasoning with System One Models
- Train An Imaginative Agent
- AnyGoal: On World Model Generalization Beyond Expert Rollouts
- ProteinGeoBench: Frontier Structural-Biology Agents Are Fluent at Lookup but Lost in Geometry
- Tandem: Serving Hybrid Linear-Attention GUI Agents on Mobile NPUs
- CARRS: A Constraint-Aware, Real-Time Routing System for Emergency Vehicles in Urban Environments
- LG-Bench: A Graph-Structured Evaluation Benchmark for Life Sciences
- Breaking Diffusion: Parallel Reasoning with Draft Refinement
- RouterWorld: Scaling Conversational AI with Latency-Aware LLM Routing
- Physiology-Aware Graph Attention for Early Ventricular Reentry Prediction
- Local data augmentation for imbalanced binary classification
- The Scheduler Is a Hidden Retriever: How Asynchrony Shapes Evidence Acquisition in Search Agents
- LOCU: Lowdin-Orthogonalized Constraint Updates for Multi-Constraint Policy Optimization
- Machina Pauliana: A neuro-symbolic approach to the actio pauliana in Dutch insolvency law
- Is This Your Agent? Identity Watermarking for Agent Systems in Dynamic Environments
- LLMs Prompted for Legal Context Refuse More: Overrefusal from Small On-Premises LLMs in Criminal Legal Context
- Map-Distribution Mixture-of-Experts for Multi-Agent Pathfinding
- ABACUS: Program-Guided Multistep Reasoning over Frozen Judgment Models
- Productive State-Space Exploration for Multi-turn RL in LLM Agents
- OrderGPT: Generation Order as a Learnable Modeling Choice
- MASIF: Implicit Failures for Process Observability in Multi-Agent Systems
- Not Every Rollout Needs Distillation: Correctness-Filtered On-Policy Self-Distillation
- When Retrieval Partially Conflicts with Skills: Understanding Procedural Hallucination in Language Models
- OpenSaC: A Python Library for Search as Code in Deep Research Agents
- ToolOPD: Credit-Aware On-Policy Distillation for Tool-Use Agents
- Neither Over- nor Under-Constrained: Evaluating LLM Personalization under a Constraint Qualification Audit
- LIRQuant: An Efficient Locally Isolated Rotation Quantization Method for Large Language Models
- Spherical Fixed-Point Reasoners: Adaptive Loop Halting on the Hypersphere
- Design and Cross-Domain Evaluation of an Agent Execution Harness
- Assessing the AI Readiness of Construction Datasets: A Multidimensional Operational Framework
- Stepwise Reasoning Verification: Don't Generate, Classify!
- Outcome-Anchored Credit Reallocation for Agentic Knowledge Graph Question Answering
- VLA-Rolling: Fewer Denoising Steps, Better Control via Adaptive Action Reuse
- Decision4Rec: A Jev-Inspired Framework of Decision Models on Knowledge and Active Graphs for Multi-Agent Recommender Systems
- Narrow Decision Models: A System-1 Architecture for Calibrated, Typed Decisions
- Beyond Explicit Intent: Discovering and Shaping Artistic Intent through Human-AI Co-Creation
- Unified Multiparadigm Fusion Intelligence for Rare Disease Diagnosis
- What Social Media Teaches Us About Accumulative AI Risks
- A Controlled LLM Workflow for Evidence-Grounded Diagnosis of Risk Score Differences
- Doing Less with More: A First-Principles Exploration of the Suitability of Agentic Computing over Alternative Architectural Choices
- Cache2LoRA: Understanding and Improving Context Internalization
- Persistent Memory and Iterative Improvement in an LLM Agent for Chinese-Character Drawing
- World of SWECraft: Agent Collaboration at Scale via Simulated Software Worlds
- A Conditional No-Hair Theorem for Transformers: How Language Models Forget Their Prompt
- Self-Improving Video-to-Action Models
- Training-Free Prompt Selection for Efficient Reinforcement Learning With Partial Rollouts
- Distillation, Self-Training, and the Fragility of Learned Chemical Reasoning
- Agents' Last Doubt: Knowing When to Act and When to Step Back in Tool-Using Agents
- AM-Bench: A Unified Taxonomy and Evaluation Suite for Agentic Misalignment
- Cortex: A Fixed-Point Theory of Governed Coding Agents - Technical Report
- Probing Ambiguity: Adversarial Intent Resolution for Robust Text-to-SQL
- CME-SpectrumBench: Can LLMs Analyze Condensed Matter Spectral Data?
- Not Every User Says It All: Training Tool-Using Agents Beyond Ideal Simulated Users
- From SEC Filings to Financial Signals: Evaluating LLMs on Stock Market Reactions and Analyst Forecasts
- FlashRT-PAI: Fast Kernels Are Not Fast Pipelines for Physical AI Inference
- Screening LLM Judges Without Ground Truth: A Preliminary Evaluation of an AI Dental Hygiene Coach
- Continuous Ontology Assurance through External Resources -- An Ontology Engineering Method with a Case Study in Software Language Engineering
- Beyond Next-Screen Prediction: The Decision Value of GUI World Models
- A Two-Stage Hybrid Framework for Inferring Air Trips from Mobile Location-based Service (LBS) Data under Incomplete Airport Sightings
- Trust the Edge, Doubt the Arrow: Auditing Validation Signals for Text-Mined Clinical Causal Knowledge Graphs
- Bridging Exploration and Persona: Information-Directed Dueling for Test-Time Agent Personalization
- Learning to Compose: Recursive Self-Improvement of Shared Executable Stacks for Zero-Shot Long-Horizon Robot Manipulation
- Hippo: Training-Free Agent Self-Evolution via Hippocampal Replay
- HABIT-Bench: Evaluating Habit Induction from Longitudinal Weak Evidence in Agent Memory
- Axiomatic World Modeling for Physics Reasoning
- $M^2Net$: Unifying Scale-Specific Structures and Prototype Decomposition for Spatial-Temporal Forecasting
- Rethinking EEG Spatial Super-Resolution as Dynamic State Decomposition and Filtering
- HSPR: Recovering Software-Agent Benchmark Scores via Hierarchical Posterior Inference
- CADS: Measuring the Incremental Contribution of LLM Proposers in Sequential Biological Screens
- Frequency-Domain Membership Inference Does Not Beat Confidence Thresholding: A Band-Resolved Analysis of Why
- Selm: Self-Evolving Library Management for Multi-Skill Agent Optimization
- Can AI agents make law? Evaluating AI legal relevance and creativity
- Spherical Physics-informed Neural Operator with Multi-scale Coupling for Meteorological Downscaling
- Verifying Human-Written Reasoning References
- Can LLM Agents Resolve Service Failures? Simulating Multi-Turn Complaint Handling under Information Asymmetry
- Neuro-Inspired Inhibitory Message Passing for Accurate and Token-Efficient Multi-Agent Reasoning
- DialogMem: Evaluating Dialogue-Grounded Embodied Memory in 3D Environments
- ReTRACE: Feedback-Guided LLM Agent in a Chemistry Harness for Retrosynthesis Planning
- Are We Evaluating VLM Token Pruning Right? Looking Beyond Accuracy and Token Count
- Pattern-Driven Evaluation of LLM Code Optimization: Isolating Compiler-Transcendent Semantic Reasoning
- Teaching Code Agents to Ask Without Leaking Private Code
- LowNet: Looped Wavelet Neural Networks with 24 Learnable Parameters for Solving Poisson Equations
- A Cross-Domain Evaluation of Prompting Techniques for Large Language Models
- HybridResearcher: Bridging the Structured-Unstructured Boundary for Deep Research Agents
- The One-Pixel of Reasoning: One Truthful Relation Is Enough to Mislead LLM Agents
- Towards Human-AI Complementarity for AI Safety
- CoworkEnv: Synthesizing Training Environments for Long-Horizon Cowork Agents
- Revealing what benchmark scores hide: Jointly measuring the breadth and reliability of LLM capabilities using accessibility profiles
- DAGLoop: Aligning Method Design with Experimental Feedback in Automated AI Research
- SteadyThought: Mitigating LLM Under-Thinking via Thought-Level Preference Optimization
- Dialogue Generation for Conversational Recommendation Using User Search Interactions and Knowledge Graphs
- Memory, Know Your PLACE: Governing Lifecycle State and Query-Time Eligibility in Persistent-Memory Agents
- Spectral Adaptive Graph Transformer for Efficient and Scalable Traffic Forecasting
- Explore or Confirm? LLM Agents Misallocate Measurements Under Noise
- CorrectRTL: Boost RTL Generation Quality Through Automated Self-Correction with Instruction Decomposition
- MemPrice: Online Memory Allocation via Adaptive Pricing for Long-Horizon Agents
- Means-Ends Analysis Helps LLMs Plan in Continuous-State Domains
- Formal Raising: Embedding Verifiable Ethical Properties into the Development of AI
- BrandEval: A Two-Track Multi-Agent Benchmark for Risk-Sensitive LLM Crisis Communication
- IndustrialCAD-1400: Benchmarking Detailed Industrial Assemblies from Text
- Toward Collective Model Intelligence: Characterizing and Coordinating Models
- Where Natural Language Ends in Agents: Executable Skill Composition with MetaSkill
- SQuIREL: A Context-Relative Framework for Measuring Entity Richness in Wikidata
- Concordance Plausibility Check for Intervention-Conditioned Human Digital Twins
- Comparing Sparsified MLPs and Transcoders: Many Transcoder Features Are Neurons in Disguise
- ConCI: A Controlled Counterfactual Benchmark for Contextual Integrity in LLMs
- Pluralistic Alignment in Language Models: Objectives, Human References, and Preference Representations
- MELD: Recursive Self-Improvement via Hierarchical Coordination for Multi-Agent Scientific Discovery
- DKnown-Jev: Fine-Tuning and Evaluation of a JEV-Style Model for Tasks Involving Normative Knowledge
- The Judge Can Debias Itself: Awareness and Self-Debiasing for Reliable LLM-as-a-Judge
- Who Speaks, Who Authorizes, Who Acts? Understanding Trust Boundaries in Multi-Agent LLMs
- SteerSearch: Interactive Search Reasoning with Mid-Response Steering
- Joint, Decoupled, or Agent: When Each Multimodal Alignment Paradigm Wins
- LogicVal:A Logic-Formalized Benchmark for Constraint Satisfaction in Text-to-Image Generation
- VibeTraining-Bench: Data-Trainer-Harness Co-Design for Iterative System Improvement
- The Control Layer Behind Rule-Following Agents Trading Across Market Conditions
- MoveBench: A Rubric-Based Benchmark for Evaluating Large Language Models in Sports and Health Coaching
- Reliable Before Profitable: QuantHarness for Governing Financial Strategy Development with LLM Agents
- EvoSkill v2: Fully Agentic Skill Evolution from Benchmark Adaptation to a Stateful Evolver
- Motor compound fault diagnosis using an attention-based cross-talk architecture
- CODA: Cohort- and Drift-aware Foundation Model for Multimodal Clinical Reasoning
- From Trace to Fix: Residual Task State in Long-Horizon Agents
- Toward Agentic Retrieval-Augmented Generation for Enterprise Retail Workflows over Heterogeneous Data Sources
- One Skill Takes Over: Clashing Agent Skills and a One-File Fix
- Bellman Language Models: Solving the Recurring Decisions of LLM Agents
- MSCR: Jointly Balancing Utilization Across Modalities and Discovering Synergistic Information
- IF-MAP: Influence-Function-Inspired Agent Prioritization in Multi-Agent Systems
- Train Locally, Learn Together: Distributed Multi-Agent Training via ADMM
- TorchTPU - A Hybrid Eager/Compiled Architecture for Native PyTorch Execution on TPU
- GardenBench: A lightweight, daily evaluation of LLM capabilities
- MM-LeJEPA: Correlated Gaussian Regularization for Multimodal Joint-Embedding Predictive Architectures
- From Prediction to Action: Population Health World Model for Digital Medicine
- Good Judgment, Bad Advice: Decision-Model Controllers Raise Agent Cost Without Improving Success
- WAQS: Weight Absorption for Quadratic Probing and Affine Steering
- Can Compact Open-Weight Large Language Models Recover Mobility Events from Incomplete Trajectories? A Controlled Evaluation Using Air Trips
- When the harness decides success: state that cannot be re-observed
- Reward Objectives for Robust (PO)MDPs: A Law-Preserving Equivalence with (Partially Observable) Games
- TimelineAgent: An LLM-based Framework for Query-Centric Event Timeline Extraction Across Multiple Documents
- Learning Which Device to Call: Online Tool Grounding for LLM Agents in IoT
- ActTime: Action-Conditioned World Modeling for Time Series
- Medical Fine-Tuning Reshapes, Not Reduces, Patient-Facing AI Risk: A Rubric-Based, LLM-Judge Evaluation Framework
Comments
Please log in to post a comment.