It is still far from truly replacing programmers: AI agents accessing enterprise private code only achieve a maximum pass rate of 40%.
48 minutes ago
Insight Beating AI News Flash: Y Combinator (YC)-incubated AI data firm Specific Labs has launched Real-SWE, a coding evaluation benchmark that tests coding agents on real private code from actual enterprises. The tasks are sourced directly from production environments, including tax calculation, bill migration, API billing, and customer data migration. Neither the code nor answers are publicly available, so agents must independently master the company’s business rules and code structure. Results show Fable 5.1 ranked first with a 38.8% pass rate; GPT-6 Astra followed at 33.8%, Gemini 3.8 Flash at 31.2%. GLM 5.3 took fourth place with 28.8%, outperforming Grok 4.6, Kimi K3, and GPT-5.6 Sol. Of the 10 currently public tasks, 6 have an overall pass rate below 15%, and one task saw all models fail. The standout performer was GLM 5.3. Real-SWE assesses agents’ ability to continuously read code, identify rules, and complete multi-step modifications in unfamiliar projects. Zhipu AI researcher Xiaopu Peng noted that his team has been training long-range tasks since GLM-5.1, and Real-SWE is more aligned with such capabilities than public SWE benchmarks, which partly explains GLM 5.3’s strong performance here.
The community of STARLINK, a meme coin in the X Layer ecosystem, has opened a donation-based charity fund to deploy network services to disaster-hit areas and network deserts.
6 minutes ago
4D Labs, a real-world embodied data layer protocol for physical AI, secures investment from YZi Labs.
6 minutes ago
Roundup of Stablecoin Demand Deposit Yields on Major CEXs: USDT Small-Tier Yields Hit Up to 10%, Bitget Offers 7.33%
6 minutes ago
Macro traders placed a $31.7 million short position on the Nasdaq ahead of the CPI.
6 minutes ago
SlowMist: ether.fi was attacked, suffering losses of approximately 15.45 ETH.
6 minutes ago
Ahead of the CPI release, Tom Lee reiterates his bullish September view: Macroeconomic data will completely ease inflation concerns, pushing the probability of a September interest rate hike to zero.
6 minutes ago
Hot feeds
A trader profits $448K by monitoring #Binance's new listings!
2024.12.13 17:37:29
Last week, funds have flowed into #Bitcoin, #Ethereum, and #Hyperliquid.
2024.12.16 14:48:36
A $PEPE whale that had been dormant for 600 days transferred all 2.1T $PEPE($52M) to a new address.
2024.12.14 10:35:27
When Elon Musk tweeted about Moltbook, the meme coin MOLT experienced a short-term 30% price surge, hitting a new all-time high of $114 million.
2026.01.31 18:37:29
A smart #AI coin trader made $17.6M on $GOAT, $ai16z, $Fartcoin,$arc.
2025.01.05 16:05:18
A sniper earned 2,277 $ETH ($8.3M) trading $SHIRO within 18 hours!
2024.12.03 23:09:08
MoreHot Articles

How did I turn $1,000 into $30,000 with smart money?
2024.12.09

10 promising AI Agent cryptos
2024.12.05

The 30-Year-Old Entrepreneur Behind Virtual, a Multi-Million Dollar AI Agent Society
2025.01.22

10 smart traders specializing in MEMEcoin trading on Solana
2024.12.09

A trader lost $73.9K trading memecoins in just 3 minutes — a lesson for us all!
2024.12.13

What is $SPORE? Let us take you through the on-chain records to show you how it works.
2024.12.25

