Search Everything in One Place

Explore the web, images, videos, news, and more – all in one place.

News

Frontier AI is faceplanting at real-world workplace tasks

Frontier AI Is Faceplanting at Real-World Workplace Tasks
Frontier AI Is Faceplanting at Real-World Workplace Tasks

"They are still far from human-level performance." The post Frontier AI Is Faceplanting at Real-World Workplace Tasks appeared first on Futurism.

To date, AI industry spending has topped $1.6 trillion, and shows no sign of slowing anytime soon.

So what do we actually have to show for it? Historically, it’s been a whole lot of nothing: as numerous studies have shown us, tools like AI chatbots and autonomous agents have been ineffective at completing real world tasks in a competent way.

The tech industry insists that’s all about to change within the next few years, as AI’s capabilities grow by leaps and bounds, enabling economic growth the likes of which the world has never seen. But is it really?

Not necessarily. A new study out of the University of California Berkeley’s Center for Responsible, Decentralized Intelligence — flagged by the College Fix — shows that frontier AI tools of all makes and models are still incapable of completing the vast majority of workplace tasks at an acceptable level, throwing a major wrench in the tech industry’s assertions that the AI revolution is imminent.

To come to that conclusion, the UC researchers designed a rigorous assessment they call the “Agents’ Last Exam,” developed to test “job-readiness” across numerous state-of-the-art AI models. Basically, the ALE — an impish riff on “Humanity’s Last Exam” — is designed to put an AI system through its paces, covering “more than 1,500 expert-sourced tasks spanning 55 occupations,” the researchers wrote in apress release.

Those test spans the typical line-up of AI-exposed jobs like software engineering and graphic design, but also a substantial number of jobs whose fates remain less certain, such as maritime engineering, agriculture, audio production, and public health operations.

Using the ALE benchmark, researchers took a hard look at advanced “closed” models — proprietary AI systems developed by private companies — like Anthropic’s Fable 5, OpenAI’s GPT-5.5, Cursor’s Composer 2.5, and Google’s Gemini 3.1 Pro. (For good measure, they also looked at two open-source models by Chinese developers.)

As cutting-edge as these AI models are, the research found that they’re far from ready for the complex needs of the modern workplace. Out of all of the models put through the gauntlet, each of them failed spectacularly. OpenAI’s GPT-5.5 came in with the highest score: a passing rate of just 24 percent overall.

“Today’s agents can solve a meaningful fraction of professional tasks,” the researchers wrote. “However, when we look at the hardest tasks that require sustained reasoning, deep domain expertise, and reliable execution over long horizons, they are still far from human-level performance.”

And as tasks became more complicated, even those meager aggregate scores fell off fast.

“On ALE’s hardest tier, every frontier agent we tested, including Fable 5, achieved a 0 percent success rate,” the presser explains.

The researchers also break down some cost considerations. The cutting edge Fable 5, they note, delivers “similar performance” to models like GPT-5.5 and Composer 2.5, “while costing roughly 4-12× more per completed task.”

Despite the horrible test results, researchers caution that the technology could still upend the job market for more AI-exposed — as plenty of corporate executives have shown us, the tech doesn’t need to work particularly well to keep workers on their back heels.

“Even if current pass rates remain relatively low, occupations dominated by routine and well-defined procedures are likely to experience disruption first, while decision-intensive roles will remain more resilient for longer,” Berkeley computer science researcher and study co-author Dawn Song told College Fix.

“The key factor,” Song added, “is not the industry itself, but the nature of the work.”

More on AI: OpenAI Appears to Be Missing Its Sales Goals by a Vast Margin

The post Frontier AI Is Faceplanting at Real-World Workplace Tasks appeared first on Futurism.

Read full story on Futurism

Related News

More stories you might be interested in.

AI border control system debuts at major airport — seeing passengers through security in seconds
New York Post·3 hours ago

AI border control system debuts at major airport — seeing passengers through security in seconds

This airport’s AI tech lets flyers fly by. The next big red carpet isn’t at a Hollywood movie premiere — it’s at the Dubai International Airport (DXB). And its AI technology is helping flyers pass through border control more quickly than ever. The new tech, which utilizes AI, biometric cameras and flight data to identify both passengers and suspicious-looking luggage in a range between six and 14 seconds, premiered at DXB last year solely for...

Top