The Model Is Only 10%: The Real Lesson of the New SDLC
AIThis post was created with the assistance of artificial intelligence (AI).

📊 Full opportunity report: The Model Is Only 10%: The Real Lesson of the New SDLC on ThorstenMeyerAI.com — validation score, market gap, and execution plan.

Prime Big Deal Days · Oct 6–7Offer from Amazon

Get school and study supplies delivered free — and shop member deals

  • Fast, free delivery on millions of items
  • Access to Prime Big Deal Days deals on October 6–7
  • Prime Video, Amazon Music and more included
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

TL;DR

A recent Google whitepaper reveals that AI models account for only 10% of system behavior. The core of effective AI development lies in harness design and context engineering, shifting focus from models to configuration and verification.

A new whitepaper by Google, authored by Addy Osmani, Shubham Saboo, and Sokratis Kartakis, states that the AI model constitutes only about 10% of a system’s behavior. The paper emphasizes that the harness and configuration account for the remaining 90%, marking a significant shift in how organizations should approach AI development and deployment.

The whitepaper, titled The New SDLC With Vibe Coding, argues that the dominant factor in AI system effectiveness is how the AI is configured, integrated, and monitored. It cites experiments where tweaking the harness—such as prompts, tools, and context policies—improved performance dramatically, even with the same underlying model. For example, a team moved a coding agent from outside the Top 30 to the Top 5 on a benchmark by changing only the harness.

The authors distinguish between vibe coding, which involves minimal structure and quick prompts, and agentic engineering, which involves formal specifications, automated testing, and human oversight. They warn that many failures are due to configuration errors, not model limitations, and that this is where organizations should focus their investment. The paper also discusses the economic implications, noting that ad-hoc prompting is often 3–10 times more costly in the long run than disciplined, structured approaches.

At a glance
reportWhen: published March 2026
The developmentGoogle’s new whitepaper highlights that the true driver of AI system performance is harness configuration, not the AI model itself.
The Model Is Only 10% — The New SDLC With Vibe Coding
AI Dispatch · Field Notes
Google · Osmani, Saboo & Kartakis · May 2026

The model is only 10%

A Google whitepaper argues software’s biggest shift is from writing code to expressing intent. Its sharpest claim: the model you obsess over is the smallest part of the system — the scaffolding around it does the real work.

A spectrum, not a binary — the differentiator is how outputs get verified
Vibe Coding
Casual prompts · “does it seem to work?” · disposable code · high risk
Structured AI-Assisted
Detailed prompts + constraints · manual testing · features in real codebases
Agentic Engineering
Formal specs · automated tests + evals + CI gates · production scale · low risk
Tests verify the deterministic; evals verify the rest. Without both, it’s vibe coding — however clever the prompt.
The idea worth building your strategy around
Agent = Model + Harness
~10%
HARNESS — prompts · tools · context · hooks · sandboxes · observability
MODEL~90% IS YOUR SURFACE AREA, NOT THE PROVIDER’S
Outside Top 30 → Top 5 on Terminal Bench 2.0 by changing only the harness — same model.
“Most agent failures, examined honestly, are configuration failures” — a missing tool, a vague rule, a noisy context.
The economics: it’s a token-cost problem (CapEx vs OpEx)
Vibe Coding
Low CapEx · High OpEx
Looks free, hides debt: token burn (fix-it loops), maintenance tax (AI spaghetti), security remediation. Crosses over to 3–10× more per feature.
Agentic Engineering
High CapEx · Low OpEx
Pay upfront (specs, evals, context), then ship cheaply. Levers: context engineering for first-pass success + intelligent model routing — cheap models for the easy work.
85%
of devs use AI coding agents (51% daily)
41%
of all new code is AI-generated
~90%
of agent behavior is the harness, not the model
+19%
longer on some tasks (METR) — verification is the cost
The read

The clearest map yet of how serious AI development works — and mostly tool-agnostic. But it’s a Google funnel: the concepts are neutral, the on-ramps point to Gemini, Jules & the ADK. If the harness is 90% and it’s yours, your moat and your costs both live there — so own your scaffolding, route across models, and remember: AI amplifies whatever engineering culture it lands in.

Source: Osmani, Saboo & Kartakis, “The New SDLC With Vibe Coding,” Google (May 2026). Figures are the paper’s own, incl. METR & LangChain. Analysis is the author’s.
thorstenmeyerai.com

Implications for AI Development and Strategy

This shift in understanding has profound implications for organizations adopting AI. It suggests that investing in harness design, context engineering, and verification can yield better results than simply chasing the latest model upgrades. The focus on configuration and process control means that long-term competitive advantage lies in how well teams can build, own, and improve their AI scaffolding, rather than relying solely on external model improvements.

For technical leaders, this means reevaluating budgets, talent, and workflows to prioritize system architecture and verification processes. It also highlights that the rapid pace of model development does not automatically translate into better outcomes unless paired with disciplined engineering practices.

Amazon

AI model validation tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Background on AI System Evolution and the SDLC Shift

The recent surge in AI adoption, driven by widespread use of AI coding agents, has led to a reevaluation of development practices. As of early 2026, reports indicate that 85% of professional developers use AI tools regularly, with 51% doing so daily, and roughly 41% of all new code being AI-generated. Despite these numbers, the whitepaper emphasizes that the core challenge is not the model itself, but how it is integrated into workflows.

The paper builds on prior trends where rapid model improvements were assumed to be the key to better AI. Instead, it advocates a paradigm shift: the true skill is in configuration, context management, and verification. This approach aligns with broader movements toward formal methods and system engineering in software development, adapted for AI’s non-deterministic nature.

“The biggest shift in software engineering isn’t a new language or framework; it’s trusting machines to turn our intent into working software.”

— Addy Osmani

Amazon

AI configuration management software

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Unclear Aspects of Implementation and Future Developments

While the paper provides compelling evidence that harness configuration is critical, it does not specify precise methodologies or best practices for organizations to adopt at scale. The extent to which these insights apply across different AI domains, such as natural language processing versus computer vision, remains to be seen. Additionally, the long-term impact on AI model development cycles and model provider strategies is still unfolding.

Amazon

automated AI testing tools

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Next Steps for Organizations and AI Developers

Organizations are likely to begin investing more heavily in harness design, context engineering, and verification tools. Industry leaders may develop standardized frameworks and best practices to optimize configuration. Meanwhile, AI providers might shift focus from solely improving models to enhancing the tools and environments that surround them. Further research and case studies are expected to validate and refine these strategies in different sectors.

Amazon

AI system monitoring solutions

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

Why is the model only 10% of the system’s behavior?

The whitepaper explains that most of what determines AI performance depends on how the model is configured, integrated, and monitored, rather than the model itself.

How can organizations improve their AI systems according to this new insight?

By focusing on harness design, context management, verification, and ongoing configuration improvements, rather than just upgrading models.

Does this mean model improvements are no longer important?

Model improvements remain valuable, but the whitepaper emphasizes that effective system design and configuration have a much larger impact on performance and cost-efficiency.

What are the economic implications of this shift?

Ad-hoc prompting and minimal structure can be more expensive long-term due to higher token costs, maintenance, and security risks. Structured, disciplined approaches offer better cost control.

Will this change how AI vendors develop their products?

Likely yes. Vendors may focus more on providing tools for harness configuration, context management, and verification, rather than solely pushing model improvements.

Source: ThorstenMeyerAI.com

HALLOWEEN

Halloween Picks

As an affiliate, we earn on qualifying purchases.

You May Also Like

The Limits Of Persistent AI Effort In Achieving Results

Despite thorough analysis, AI models struggle to complete decisive business actions, highlighting limits of persistent effort in automation.

Fable 5 Is Back. GPT-5.6 Is Next. And Anthropic Reportedly Already Has Something Stronger.

Fable 5 is back after an 18-day blackout; GPT-5.6 is in limited preview; rumors suggest Anthropic has an even more capable model. Development is ongoing.

Mistral Forge: Owning the Model, Not Just Renting the API

Mistral’s Forge enables organizations to build and operate their own AI models, moving beyond API rentals to full ownership and control, with specific use cases in mind.

Five Levers, Many Hands

Exploring how different countries respond to AI-driven labor shifts using five key policy tools amid deep uncertainty about the future.