CAE-Bench is a new benchmark designed to evaluate the capability of AI agents to develop generalized Computer-Aided Engineering (CAE) solvers. It tests agents by requiring them to create solvers on a limited set of public cases and evaluating performance on previously unseen test cases across 80 computational tasks.
Real-time intelligence for the AI Agent Economy
Companies, agents, frameworks, protocols and events — structured and scored.
- Events · 24h
- 10
- Events tracked
- 300
- Entities
- 500
- Source reports
- 300
WordInferBench is a new benchmark designed to assess how effectively AI coding agents can infer formatting attributes from document context rather than relying on explicit instructions. Testing of six current coding agents reveals a significant performance drop when tasks require contextual inference compared to descriptive instructions, with Claude Code reaching only 40.7% on inferential tasks.
Researchers have proposed a prediction-market-based incentive structure to solve the problem of identity manipulation in open frontier challenges. The method aims to discourage participants from using multiple accounts to game prize rankings by ensuring that rewards are proportional to genuine performance improvements.
Production-ready vector storage for AI agents. Sub-10ms retrieval at billion scale.