AI attempts to migrate entire codebases have a 94.6% failure rate, with 13 out of 20 tasks unsuccessful.
1 hours ago
Beating AI News reports that AI agent firm Einsia has launched the SWE Refactor Bench, a benchmark designed to test coding agents’ ability to fully migrate entire codebases independently. The 20 tasks are sourced from real-world projects including SQLite, zlib, libsodium, and GraphHopper, covering scenarios such as C-to-Rust conversion, Maven-to-Gradle migration, and SQLite porting to WASI. Each task grants agents 6 to 30 hours to complete. The evaluation process has three stages: first, verifying that old tech stacks are fully replaced to prevent agents from cutting corners by retaining old code; second, running over 130,000 static checks; finally, six independent coding agents spend one hour each to identify hidden bugs. A total of 520 runs were conducted across 8 leading models and 26 configurations. Of these, 340 successfully completed migration, 88 passed all pre-written test cases, yet 60 of those were found to have hidden bugs in the final stage. Only 28 runs fully passed all stages, resulting in a 5.4% pass rate; 13 out of the 20 tasks were never completed by any agent. Claude Opus 5’s xhigh configuration performed best, fully completing 5 of the 20 tasks. Current coding agents can perform large-scale code modifications, but they still have a long way to go to achieve error-free full-system refactoring.
MINIMAX reports H1 revenue of $117 million, up 283.1% year-over-year.
1 seconds ago
An address has accumulated a total of 6,000 ETH since August 17, with an unrealized profit of approximately $130,000.
1 seconds ago
A crypto whale has placed a long-term TWAP buy order that has been outstanding for 5 days, and plans to go long AAPL with 20x leverage.
1 seconds ago
Ansem Invests $57,000 to Buy Tokens of NetNet Capital, a DeFi Protocol on the Robinhood Chain.
1 seconds ago
Skild AI unveils new robotics foundation model S1: can learn new tasks from just a single video.
1 seconds ago
Analyst: Bitcoin on-chain capital inflows turn positive for the first time in nearly three months, yet demand strength remains at a historic low.
1 seconds ago
Hot feeds
A trader profits $448K by monitoring #Binance's new listings!
2024.12.13 17:37:29
Last week, funds have flowed into #Bitcoin, #Ethereum, and #Hyperliquid.
2024.12.16 14:48:36
A $PEPE whale that had been dormant for 600 days transferred all 2.1T $PEPE($52M) to a new address.
2024.12.14 10:35:27
When Elon Musk tweeted about Moltbook, the meme coin MOLT experienced a short-term 30% price surge, hitting a new all-time high of $114 million.
2026.01.31 18:37:29
A smart #AI coin trader made $17.6M on $GOAT, $ai16z, $Fartcoin,$arc.
2025.01.05 16:05:18
A sniper earned 2,277 $ETH ($8.3M) trading $SHIRO within 18 hours!
2024.12.03 23:09:08
MoreHot Articles

How did I turn $1,000 into $30,000 with smart money?
2024.12.09

10 promising AI Agent cryptos
2024.12.05

The 30-Year-Old Entrepreneur Behind Virtual, a Multi-Million Dollar AI Agent Society
2025.01.22

10 smart traders specializing in MEMEcoin trading on Solana
2024.12.09

A trader lost $73.9K trading memecoins in just 3 minutes — a lesson for us all!
2024.12.13

What is $SPORE? Let us take you through the on-chain records to show you how it works.
2024.12.25

