AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
Live on firmulate.com.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get beauty and skincare favorites delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

Beauty Meets Business Automation: The Future Is Now

Imagine a scenario where artificial intelligence isn’t just automated customer support but acts as an active manager, making decisions under pressure while safeguarding a company’s integrity. This isn’t science fiction — it’s happening today, even in the world of beauty and personal care, where trust and reputation are everything.

Amazon

AI decision-making software for business

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Real-World Experiment: AI Running a Business

In a groundbreaking live experiment, four advanced AI models were tasked with running a small software company through its worst week — facing crises, customer temptations, and ethical dilemmas, all in real-time. The goal? To see which AI could best maintain honesty, identify critical information, and ultimately secure a deal worth €55,000 in recurring revenue.

This setup isn’t just theoretical; it’s a real, ongoing operation at firmulate.com, where the AI models make decisions in a live environment with real money, real customers, and complex challenges. The experiment measures management skills, not just chat quality, highlighting AI’s growing role in decision-making processes.

Amazon

business crisis management AI tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Results Show a Clear Leader — and Surprising Insights

All four models successfully identified every crisis and refused manipulative tactics, such as fake CEO messages or secret requests. Yet, only two managed to close the deal by thoroughly reading and analyzing their company’s internal files. The winner, gpt-5.6-sol, scored the highest at 95 — just behind the second-place Kimi K3 at 93 — demonstrating that the AI could find buried facts crucial for business success.

This buried fact was hidden two document references deep in the company’s files — a detail that, if overlooked, could have cost the deal. The AI that read the full context closed at full price, adding €4,583 MRR to the company’s monthly revenue. Conversely, the other models, despite accurate diagnosis and refusal of manipulation, left the deal on the table, highlighting the importance of thorough analysis and discipline.

Amazon

ethical AI decision support systems

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

What About Trust and Integrity?

In a social engineering test, fake CEO messages escalated over three stages, along with a reporter trick asking for a quick, background approval. All models refused these manipulative requests, with Kimi K3 explicitly treating the request as a possible impersonation or bypass attempt. This demonstrates that AI is not just about finding facts but also about maintaining ethical standards under pressure.

Amazon

AI document analysis tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

The Human-Like Struggles of AI

The experiment used a simulated company with 13 employees and a monthly burn of €105k against a revenue of just €2.3k — a real-world challenge. The AI had to navigate complex rules, over 680 learned procedures, and every decision was documented and time-stamped. The AI’s discipline and focus made a significant difference, as seen in the performance gap among the models.

The Unexpected Weaknesses of the Experienced

The most thorough participant, Opus 4.8, with over 80 learned rules and deep analyses, scored the lowest — 73. It left opportunities unseized and slipped discipline, such as escalating issues into locked departments instead of resolving them directly. This reveals that even the most experienced AI can falter when discipline slips, emphasizing the need for focus and clear protocols.

Fairness and Transparency in AI Testing

It’s important to note that Kimi K3 ran without an effort parameter (the API default), whereas the others operated at high effort levels, ensuring a fair comparison. This transparency underscores the importance of testing AI models under consistent conditions to truly understand their capabilities and limitations.

The Broader Implication: Choosing the Right AI

For companies in personal care and beauty, the takeaway is straightforward: it’s no longer just about chat quality or superficial capabilities. When AI takes on management roles, its ability to finish tasks, read critical information, and stay honest under pressure makes all the difference. The league table shows that even a newcomer like Kimi K3 can outperform veteran models, making the choice of AI model a strategic decision rather than a gamble.

To see these models in action, or to test your own business, visit firmulate.com and explore how live AI management experiments could transform your operations.

Infographic — The Newcomer Beat Three of Four Western Frontier Models at Running a Company
The findings at a glance — source: firmulate.com.

Key Takeaway

In live experiments, AI models like Kimi K3 proved they can manage crises, identify hidden details, and maintain integrity better than older models. The right AI isn’t just about chat — it’s about finishing what it starts, reading deeply, and staying honest under pressure.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI

Wellness content on this site is informational and not a substitute for professional medical guidance.


FALL

Fall Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

Decoding White Spots on Nails: Causes, Myths, and Facts

Gaining insight into white spots on nails reveals common causes and debunks myths, but understanding the full story might surprise you.

How Lamp Wattage Affects Cure Performance

Ineffective curing may result from improper lamp wattage, so understanding its impact is essential for optimizing your curing process and ensuring quality results.

The Microbiology of Nails: What Lives Under Your Fingernails?

I’m about to reveal the surprising microbial world beneath your nails and how it impacts your health—discover what truly lives under your fingertips.

Genetics and Nail Strength: Why Some People Have Naturally Stronger Nails

Ongoing genetic factors influence nail strength, revealing why some people naturally have tougher nails and how understanding this can improve your nail care.