What Happened
Three developments stand out for enterprise AI buyers: more open-weight model choices, a push toward persistent agents, and growing constraints on the infrastructure behind them.
- Open models gained ground, with different trade-offs. Ricursive released the Apache 2.0-licensed Ripple-65B Preview and claims a leading TerminalBench 2.1 score among U.S. open models. Thinking Machines released Inkling 2 Small, a 594-billion-parameter mixture-of-experts model that claims stronger overall Western open-weight performance but uses substantially more tokens for agentic work. These are vendor claims, not a reason to skip workload-specific testing. [1] [19]
- Agents are becoming longer-running and more integrated. Perplexity introduced Teammates, agents that work on ongoing projects in their own virtual machines, available on its $200-per-month Max plan. GitLab’s generally available MCP server expands access for external development agents, while Atomicwork announced prebuilt AI coworkers for IT and security teams. [10] [22] [17]
- Compute plans face commercial and political pressure. Microsoft is reportedly winding down Oracle capacity using older Nvidia chips. TSMC is considering 3D DRAM manufacturing at Nvidia’s request amid memory shortages. In U.S. midterm voting, majorities favored tighter data-center restrictions in 40 of 41 related ballot measures. [5] [14] [6]
- AI security is moving in both directions. AWS made a service generally available that tests whether code findings are exploitable in a sandbox and proposes pull-request fixes. Separately, U.S. prosecutors allege that criminals used AI impersonations of executives and lawyers in a fraud scheme exceeding $129 million. [27] [8]
Why It Matters to Businesses
Model benchmarks, agent features and infrastructure commitments do not establish business value on their own. Buyers need to measure outcomes they already manage—such as resolution time, accepted code changes, fraud losses and cost per completed task—rather than create AI-specific success metrics with no operational meaning. That is also the central advice in AWS’s discussion of AI measurement. [3]
Open weights may offer more deployment control, but total cost depends on token consumption, serving capacity and the amount of human review a task requires. Persistent agents add another cost: credentials, virtual machines and unattended activity must be governed for the life of a project, not just during a chat session. [1] [19] [10]
Kimbodo Engineering Perspective
We would treat today’s releases as candidates for a controlled evaluation, not as platform decisions. A smaller model that completes a task reliably with fewer tokens and less intervention can be the better production choice than a higher-ranked model. Likewise, an agent’s ability to act is useful only when its scope, approvals and audit trail match the risk of the action.
The infrastructure news argues for avoiding assumptions about permanent access to a particular GPU generation, cloud partner or data-center location. Research claims warrant similar discipline: METR found evidence that AI-assisted research accelerated Anthropic’s model development, but important underlying evidence was redacted and some inside Anthropic dispute the interpretation. [5] [6] [18]
How We Would Implement It
- Build a task-based evaluation set: test representative coding, support or IT workflows against the incumbent and candidate models; record completion quality, elapsed time, tokens, human corrections and cost per accepted result.
- Put agents behind an execution boundary: use isolated, short-lived environments; narrowly scoped credentials; explicit tool allowlists; and approval gates for merges, production changes, payments or access grants.
- Make activity observable: retain tool-call logs, model and prompt versions, approvals, and resulting artifacts so teams can reconstruct an agent’s actions and investigate failures.
- Plan for supply changes: benchmark at least two viable deployment options and define capacity and cost thresholds that trigger a switch or a workload reduction.
Risks, Costs and Security
Always-on agents can accumulate compute charges and expand the window in which a compromised credential can do harm. Automated vulnerability fixes also need tests and human approval before merging: demonstrating exploitability in a sandbox does not prove a proposed patch is safe in production. [10] [27]
AI-enabled impersonation makes payment and account-change controls especially important. Require out-of-band verification through a known channel, separation of duties and transaction limits; do not treat a convincing voice, message or document as authorization. For infrastructure investments, distinguish contracted capacity from demonstrated utilization and economic return, particularly where permitting and supply remain uncertain. [8] [15] [29]
Where Kimbodo Comes In
Kimbodo builds and operates this in production for businesses — see our AI Consulting & Strategy practice, or Request an AI Roadmap.
Sources
- [1] Ripple-65B Preview delivers strong agentic coding results as a fully Apache 2.0 open US model
- [3] AWS’ Colleen Aubrey: Stop inventing new AI metrics — it’s your business metrics that matter
- [5] Sources: Microsoft has been turning off rented computing capacity from Oracle after declining to renew a 2023 deal, because the hardware used older Nvidia chips (Brody Ford/Bloomberg)
- [6] How a Blue Wave midterm might reshape the AI industry
- [8] The US DOJ indicts three foreign nationals for allegedly using AI to impersonate CEOs and attorneys at major international law firms in a $129M+ fraud scheme (Rebecca Cohen/NBC News)
- [10] Perplexity now has its own always-on AI agent
- [14] Sources: TSMC is considering expanding into manufacturing 3D DRAM at the request of Nvidia, its biggest customer, amid memory chip shortages due to the AI boom (Qianer Liu/The Information)
- [15] The AI boom’s missing balance-sheet question: What has actually been verified?
- [17] Atomicwork launches certified AI coworker marketplace for enterprise IT and security
- [18] METR finds Anthropic may have crossed its own AI acceleration warning threshold back in July
- [19] Thinking Machines' Inkling 2 Small claims top spot among western open-weight models
- [22] GitLab 19.5 Makes Agentic Development a Governed Part of the DevOps Platform
- [27] AWS Ships Continuum for Code Vulnerabilities
- [29] Cleanview: ~40% of pending US data center capacity is planned to be built in states where newly elected governors have pledged to stop or pause construction (Bloomberg)