view article Article OpenEnv in Practice: Evaluating Tool-Using Agents in Real-World Environments +3 9 days ago • 24
SPIRAL: Symbolic LLM Planning via Grounded and Reflective Search Paper • 2512.23167 • Published Dec 29, 2025 • 1
view article Article Community Evals: Because we're done trusting black-box leaderboards over the community +5 17 days ago • 72
Enterprise Agents and Benchmarks Collection Enterprise agent ecosystem featuring AssetOpsBench (industrial) and ITBench (SRE, FinOps, CISO), CUGA to accelerate AI Automation • 10 items • Updated 6 days ago • 14
view article Article AssetOpsBench: Bridging the Gap Between AI Agent Benchmarks and Industrial Reality about 1 month ago • 31
AI-Agent-4-Industry-4.0 Collection This category highlights the collective efforts of the AI Automation team in advancing Industry 4.0 applications and exploring innovations beyond it. • 6 items • Updated Oct 8, 2025 • 7
Granite Time Series Models Collection A collection of time series models trained by IBM licensed under Apache 2.0 license. • 8 items • Updated Nov 17, 2025 • 45
Multi-Agent Design: Optimizing Agents with Better Prompts and Topologies Paper • 2502.02533 • Published Feb 4, 2025 • 4
AssetOpsBench: Benchmarking AI Agents for Task Automation in Industrial Asset Operations and Maintenance Paper • 2506.03828 • Published Jun 4, 2025 • 17
Compound AI Systems Optimization: A Survey of Methods, Challenges, and Future Directions Paper • 2506.08234 • Published Jun 9, 2025 • 9
SmartPilot: A Multiagent CoPilot for Adaptive and Intelligent Manufacturing Paper • 2505.06492 • Published May 10, 2025 • 2
FailureSensorIQ: A Multi-Choice QA Dataset for Understanding Sensor Relationships and Failure Modes Paper • 2506.03278 • Published Jun 3, 2025 • 6