Imagine managing a busy poolside business where every decision counts — from handling stressed clients to closing big deals. Now, picture doing this with the help of artificial intelligence. The question isn’t just whether AI can chat well, but whether it can actually manage, decide, and deliver under real-world pressure.
The Live AI Management Experiment: Putting AI to the Test
At Firmulate, a company dedicated to measuring AI decision-making in realistic scenarios, four leading frontier AI models faced the same challenge: run a small software company through its worst week. This is no simple simulation — it’s a real-time, auditable test where every crisis, temptation, and opportunity was identical across all models.
Each AI model was tasked with managing a company that had to navigate difficult customer interactions, potential fraud, and tough negotiations. The stakes were high: only two models managed to close a key €55,000 deal based solely on their own analysis. Despite all models recognizing every crisis and refusing manipulation attempts — such as fake CEO messages or reporter tricks — only some were able to follow through and sign the deal.
The Metrics of Success
- The models scored on their ability to detect critical information, make sound decisions, and maintain integrity under pressure.
- Scores ranged from 95 for the top performer, GPT-5.6-sol, down to 73 for Opus 4.8, with the baseline at 26.
- Notably, the models that read deeper into internal documents were more successful at closing the high-value deal, highlighting the importance of thorough information processing.
Personality and Decision Styles
The models displayed distinct management personalities. The most thorough, Opus 4.8, analyzed more rules and conducted deeper assessments but ultimately fell short on closing the deal — showing discipline slips under pressure. Meanwhile, Kimi K3, the newcomer, demonstrated the cleanest discipline, closing at 93 points and refusing all manipulative tactics, including escalating fake CEO requests.
AI decision-making software tools
As an affiliate, we earn on qualifying purchases.
As an affiliate, we earn on qualifying purchases.
The Real-World Stakes
This experiment isn’t just a game. It’s a glimpse into how AI could someday run or assist actual businesses — especially in high-stakes environments like customer support, financial decision-making, or operations. The experiment runs daily on a live company, which currently burns €105,000 monthly against a modest €2,300 in monthly recurring revenue, illustrating how critical sound management is for real companies.
The Surprising Findings
Perhaps the most revealing fact is that the decisive advantage came from reading and understanding internal documents, not just reacting to immediate customer crises. This buried knowledge made the difference in sealing the deal at full price — worth over €4,583 in monthly recurring revenue.
Furthermore, all models correctly refused to be manipulated via social engineering tactics, such as staged CEO messages or background questions from reporters. Kimi K3’s reasoning was straightforward: treat such requests as suspicious approval-bypasses or impersonation risks, reflecting a cautious and security-minded management style.
Why This Matters for Your Business
The key takeaway isn’t whether AI can churn out polished chat responses — it’s whether it can truly manage and make decisions that matter under real-world pressures. For pools, patios, or water features, this underscores the importance of choosing AI tools capable of finishing what they start, reading internal data thoroughly, and maintaining integrity when it counts most.
If you’re considering AI helpers for your water lifestyle business, remember: success isn’t measured by how well they talk, but by how well they manage, decide, and deliver consistent results. The leaderboard scores—from 95 down to 73—reveal that even the best AI models can have weaknesses, especially if they don’t read deeply enough or stay disciplined under stress.
Test Your AI Knowledge
Curious which model might match your management style? Take the free quiz to see how different AI personalities perform in management scenarios. Whether you want a thorough strategist or a straightforward operator, understanding these differences can help you make smarter decisions about your AI workforce.
Experience the Future Today
And if you’re ready to see this in action, you can explore the live company running every business day at firmulate.com. Watch real decisions unfold, learn how AI handles crises, and get a taste of how AI could one day manage your own business — no fiction, just real data and real results.
Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html
