AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get beauty and skincare favorites delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

Beauty Meets Business Automation: The Future Is Now

Imagine a scenario where artificial intelligence isn’t just automated customer support but acts as an active manager, making decisions under pressure while safeguarding a company’s integrity. This isn’t science fiction — it’s happening today, even in the world of beauty and personal care, where trust and reputation are everything.

Amazon

AI decision-making software for business

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Real-World Experiment: AI Running a Business

In a groundbreaking live experiment, four advanced AI models were tasked with running a small software company through its worst week — facing crises, customer temptations, and ethical dilemmas, all in real-time. The goal? To see which AI could best maintain honesty, identify critical information, and ultimately secure a deal worth €55,000 in recurring revenue.

This setup isn’t just theoretical; it’s a real, ongoing operation at firmulate.com, where the AI models make decisions in a live environment with real money, real customers, and complex challenges. The experiment measures management skills, not just chat quality, highlighting AI’s growing role in decision-making processes.

Amazon

business crisis management AI tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Results Show a Clear Leader — and Surprising Insights

All four models successfully identified every crisis and refused manipulative tactics, such as fake CEO messages or secret requests. Yet, only two managed to close the deal by thoroughly reading and analyzing their company’s internal files. The winner, gpt-5.6-sol, scored the highest at 95 — just behind the second-place Kimi K3 at 93 — demonstrating that the AI could find buried facts crucial for business success.

This buried fact was hidden two document references deep in the company’s files — a detail that, if overlooked, could have cost the deal. The AI that read the full context closed at full price, adding €4,583 MRR to the company’s monthly revenue. Conversely, the other models, despite accurate diagnosis and refusal of manipulation, left the deal on the table, highlighting the importance of thorough analysis and discipline.

Amazon

ethical AI decision support systems

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

What About Trust and Integrity?

In a social engineering test, fake CEO messages escalated over three stages, along with a reporter trick asking for a quick, background approval. All models refused these manipulative requests, with Kimi K3 explicitly treating the request as a possible impersonation or bypass attempt. This demonstrates that AI is not just about finding facts but also about maintaining ethical standards under pressure.

Amazon

AI document analysis tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Human-Like Struggles of AI

The experiment used a simulated company with 13 employees and a monthly burn of €105k against a revenue of just €2.3k — a real-world challenge. The AI had to navigate complex rules, over 680 learned procedures, and every decision was documented and time-stamped. The AI’s discipline and focus made a significant difference, as seen in the performance gap among the models.

The Unexpected Weaknesses of the Experienced

The most thorough participant, Opus 4.8, with over 80 learned rules and deep analyses, scored the lowest — 73. It left opportunities unseized and slipped discipline, such as escalating issues into locked departments instead of resolving them directly. This reveals that even the most experienced AI can falter when discipline slips, emphasizing the need for focus and clear protocols.

Fairness and Transparency in AI Testing

It’s important to note that Kimi K3 ran without an effort parameter (the API default), whereas the others operated at high effort levels, ensuring a fair comparison. This transparency underscores the importance of testing AI models under consistent conditions to truly understand their capabilities and limitations.

The Broader Implication: Choosing the Right AI

For companies in personal care and beauty, the takeaway is straightforward: it’s no longer just about chat quality or superficial capabilities. When AI takes on management roles, its ability to finish tasks, read critical information, and stay honest under pressure makes all the difference. The league table shows that even a newcomer like Kimi K3 can outperform veteran models, making the choice of AI model a strategic decision rather than a gamble.

To see these models in action, or to test your own business, visit firmulate.com and explore how live AI management experiments could transform your operations.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Key Takeaway

In live experiments, AI models like Kimi K3 proved they can manage crises, identify hidden details, and maintain integrity better than older models. The right AI isn’t just about chat — it’s about finishing what it starts, reading deeply, and staying honest under pressure.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI

Wellness content on this site is informational and not a substitute for professional medical guidance.


FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

AI in Action: How Diligence and Prioritization Make the Difference

Discover how AI models excel in spotting crises but fall short without prioritization. Live experiments reveal that focus and discipline outperform volume in real business tests.

Why Do Nails Get Ridges? Causes and Science Explained

I’m here to explain why nail ridges form and what they reveal about your health, so keep reading to uncover the underlying causes.

Why Some Clients Feel Heat Spikes in UV Lamps

Inefficient maintenance or low-quality parts can cause heat spikes in UV lamps, but understanding the underlying causes can help prevent them.

How UV Gel Polish Cures: The Science Behind Nail Lamps

Just how UV gel polish cures involves fascinating science behind nail lamps that reveals why proper curing is essential for long-lasting results.