AI Agent Scientific Task Field Test: The Strongest Performer Only Completes 20.6% of Tasks Fully
1 hours ago
Dongcha’s Beating AI News reports that Apodex, a new AI project under Chen Tianqiao, has released FrontierChallenge, a scientific agent benchmark that tests whether AI can complete tasks end-to-end using 97 real-world scientific workflows. Twelve leading models participated in the test, with the best performance reaching only 20.6%. GPT-5.6 Sol + Codex and Grok 4.6 + Claude Code tied for first place, each fully completing 20 tasks. The test also found that agents often claim to have finished tasks even when they are incomplete. Among 10 model groups using Claude Code as the agent framework, 75.5% of 849 failed tasks were falsely reported as completed. On the other hand, all participating systems scored an average of 94.9 on electrochemistry and environmental science tasks, but none fully passed any task. This benchmark explicitly separates "mostly correct" results from "truly completed deliverables". The ranking compares models plus agent runtime frameworks, not bare models alone. The official also reminded that each system is allowed only one run per task, so small score gaps should not be directly interpreted as a stable model ranking.
Powell signals an interest rate hike, as the Fed’s policy remains focused on inflation.
7 minutes ago
As the probability of an interest rate hike rises, all crypto-related stocks in the US stock market have fallen across the board.
7 minutes ago
Spot gold once fell below $4,550 per ounce, hitting its lowest level since August 21.
7 minutes ago
Market pricing indicates that the current probability of a Federal Reserve interest rate hike in September is around 50%.
7 minutes ago
U.S. job growth revised downward, signs of labor market cooling more evident.
7 minutes ago
Walsh: Inflation remains above target, the Federal Reserve still has work to do.
7 minutes ago
Hot feeds
A trader profits $448K by monitoring #Binance's new listings!
2024.12.13 17:37:29
Last week, funds have flowed into #Bitcoin, #Ethereum, and #Hyperliquid.
2024.12.16 14:48:36
A $PEPE whale that had been dormant for 600 days transferred all 2.1T $PEPE($52M) to a new address.
2024.12.14 10:35:27
When Elon Musk tweeted about Moltbook, the meme coin MOLT experienced a short-term 30% price surge, hitting a new all-time high of $114 million.
2026.01.31 18:37:29
A smart #AI coin trader made $17.6M on $GOAT, $ai16z, $Fartcoin,$arc.
2025.01.05 16:05:18
A sniper earned 2,277 $ETH ($8.3M) trading $SHIRO within 18 hours!
2024.12.03 23:09:08
MoreHot Articles

How did I turn $1,000 into $30,000 with smart money?
2024.12.09

10 promising AI Agent cryptos
2024.12.05

The 30-Year-Old Entrepreneur Behind Virtual, a Multi-Million Dollar AI Agent Society
2025.01.22

10 smart traders specializing in MEMEcoin trading on Solana
2024.12.09

A trader lost $73.9K trading memecoins in just 3 minutes — a lesson for us all!
2024.12.13

What is $SPORE? Let us take you through the on-chain records to show you how it works.
2024.12.25

