The Model Is Only 10%: The Real Lesson of the New SDLC
AIThis post was created with the assistance of artificial intelligence (AI).

📊 Full opportunity report: The Model Is Only 10%: The Real Lesson of the New SDLC on ThorstenMeyerAI.com — validation score, market gap, and execution plan.

TL;DR

A recent Google whitepaper reveals that AI models account for only 10% of system behavior. The core of effective AI development lies in harness design and context engineering, shifting focus from models to configuration and verification.

A new whitepaper by Google, authored by Addy Osmani, Shubham Saboo, and Sokratis Kartakis, states that the AI model constitutes only about 10% of a system’s behavior. The paper emphasizes that the harness and configuration account for the remaining 90%, marking a significant shift in how organizations should approach AI development and deployment.

The whitepaper, titled The New SDLC With Vibe Coding, argues that the dominant factor in AI system effectiveness is how the AI is configured, integrated, and monitored. It cites experiments where tweaking the harness—such as prompts, tools, and context policies—improved performance dramatically, even with the same underlying model. For example, a team moved a coding agent from outside the Top 30 to the Top 5 on a benchmark by changing only the harness.

The authors distinguish between vibe coding, which involves minimal structure and quick prompts, and agentic engineering, which involves formal specifications, automated testing, and human oversight. They warn that many failures are due to configuration errors, not model limitations, and that this is where organizations should focus their investment. The paper also discusses the economic implications, noting that ad-hoc prompting is often 3–10 times more costly in the long run than disciplined, structured approaches.

At a glance
reportWhen: published March 2026
The developmentGoogle’s new whitepaper highlights that the true driver of AI system performance is harness configuration, not the AI model itself.
The Model Is Only 10% — The New SDLC With Vibe Coding
AI Dispatch · Field Notes
Google · Osmani, Saboo & Kartakis · May 2026

The model is only 10%

A Google whitepaper argues software’s biggest shift is from writing code to expressing intent. Its sharpest claim: the model you obsess over is the smallest part of the system — the scaffolding around it does the real work.

A spectrum, not a binary — the differentiator is how outputs get verified
Vibe Coding
Casual prompts · “does it seem to work?” · disposable code · high risk
Structured AI-Assisted
Detailed prompts + constraints · manual testing · features in real codebases
Agentic Engineering
Formal specs · automated tests + evals + CI gates · production scale · low risk
Tests verify the deterministic; evals verify the rest. Without both, it’s vibe coding — however clever the prompt.
The idea worth building your strategy around
Agent = Model + Harness
~10%
HARNESS — prompts · tools · context · hooks · sandboxes · observability
MODEL~90% IS YOUR SURFACE AREA, NOT THE PROVIDER’S
Outside Top 30 → Top 5 on Terminal Bench 2.0 by changing only the harness — same model.
“Most agent failures, examined honestly, are configuration failures” — a missing tool, a vague rule, a noisy context.
The economics: it’s a token-cost problem (CapEx vs OpEx)
Vibe Coding
Low CapEx · High OpEx
Looks free, hides debt: token burn (fix-it loops), maintenance tax (AI spaghetti), security remediation. Crosses over to 3–10× more per feature.
Agentic Engineering
High CapEx · Low OpEx
Pay upfront (specs, evals, context), then ship cheaply. Levers: context engineering for first-pass success + intelligent model routing — cheap models for the easy work.
85%
of devs use AI coding agents (51% daily)
41%
of all new code is AI-generated
~90%
of agent behavior is the harness, not the model
+19%
longer on some tasks (METR) — verification is the cost
The read

The clearest map yet of how serious AI development works — and mostly tool-agnostic. But it’s a Google funnel: the concepts are neutral, the on-ramps point to Gemini, Jules & the ADK. If the harness is 90% and it’s yours, your moat and your costs both live there — so own your scaffolding, route across models, and remember: AI amplifies whatever engineering culture it lands in.

Source: Osmani, Saboo & Kartakis, “The New SDLC With Vibe Coding,” Google (May 2026). Figures are the paper’s own, incl. METR & LangChain. Analysis is the author’s.
thorstenmeyerai.com

Implications for AI Development and Strategy

This shift in understanding has profound implications for organizations adopting AI. It suggests that investing in harness design, context engineering, and verification can yield better results than simply chasing the latest model upgrades. The focus on configuration and process control means that long-term competitive advantage lies in how well teams can build, own, and improve their AI scaffolding, rather than relying solely on external model improvements.

For technical leaders, this means reevaluating budgets, talent, and workflows to prioritize system architecture and verification processes. It also highlights that the rapid pace of model development does not automatically translate into better outcomes unless paired with disciplined engineering practices.

AI Model Validation & Testing: Ensuring Reliable AI Systems — Bias Testing, Robustness Evaluation & Regulatory Compliance (AI Compliance Toolkit)

AI Model Validation & Testing: Ensuring Reliable AI Systems — Bias Testing, Robustness Evaluation & Regulatory Compliance (AI Compliance Toolkit)

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Background on AI System Evolution and the SDLC Shift

The recent surge in AI adoption, driven by widespread use of AI coding agents, has led to a reevaluation of development practices. As of early 2026, reports indicate that 85% of professional developers use AI tools regularly, with 51% doing so daily, and roughly 41% of all new code being AI-generated. Despite these numbers, the whitepaper emphasizes that the core challenge is not the model itself, but how it is integrated into workflows.

The paper builds on prior trends where rapid model improvements were assumed to be the key to better AI. Instead, it advocates a paradigm shift: the true skill is in configuration, context management, and verification. This approach aligns with broader movements toward formal methods and system engineering in software development, adapted for AI’s non-deterministic nature.

“The biggest shift in software engineering isn’t a new language or framework; it’s trusting machines to turn our intent into working software.”

— Addy Osmani

YAML Made Simple: A Beginner’s Guide to Configuration and Data Structuring

YAML Made Simple: A Beginner’s Guide to Configuration and Data Structuring

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Unclear Aspects of Implementation and Future Developments

While the paper provides compelling evidence that harness configuration is critical, it does not specify precise methodologies or best practices for organizations to adopt at scale. The extent to which these insights apply across different AI domains, such as natural language processing versus computer vision, remains to be seen. Additionally, the long-term impact on AI model development cycles and model provider strategies is still unfolding.

HDCCDM Portable Vision Screener, 7 Inch HD Auto Refractor with Data Storage Function, 0-180° Axis Number & 98cm Measuring Distance, for Optic Ophthalmic Equipment

HDCCDM Portable Vision Screener, 7 Inch HD Auto Refractor with Data Storage Function, 0-180° Axis Number & 98cm Measuring Distance, for Optic Ophthalmic Equipment

  • Eye Health Screening: Infrared rays for safe, quick eye scans
  • Optical Refraction Analysis: Measures lens diameters and eye axis
  • User-Friendly Operation: One-touch automated eye screening

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Next Steps for Organizations and AI Developers

Organizations are likely to begin investing more heavily in harness design, context engineering, and verification tools. Industry leaders may develop standardized frameworks and best practices to optimize configuration. Meanwhile, AI providers might shift focus from solely improving models to enhancing the tools and environments that surround them. Further research and case studies are expected to validate and refine these strategies in different sectors.

Intelligent Systems and Sustainable Solutions for AIOT-Powered Environmental Monitoring

Intelligent Systems and Sustainable Solutions for AIOT-Powered Environmental Monitoring

As an affiliate, we earn on qualifying purchases.

As an affiliate, we earn on qualifying purchases.

Key Questions

Why is the model only 10% of the system’s behavior?

The whitepaper explains that most of what determines AI performance depends on how the model is configured, integrated, and monitored, rather than the model itself.

How can organizations improve their AI systems according to this new insight?

By focusing on harness design, context management, verification, and ongoing configuration improvements, rather than just upgrading models.

Does this mean model improvements are no longer important?

Model improvements remain valuable, but the whitepaper emphasizes that effective system design and configuration have a much larger impact on performance and cost-efficiency.

What are the economic implications of this shift?

Ad-hoc prompting and minimal structure can be more expensive long-term due to higher token costs, maintenance, and security risks. Structured, disciplined approaches offer better cost control.

Will this change how AI vendors develop their products?

Likely yes. Vendors may focus more on providing tools for harness configuration, context management, and verification, rather than solely pushing model improvements.

Source: ThorstenMeyerAI.com

You May Also Like

How Tech Giants Use AI To Maintain Market Dominance

Examining how leading tech firms leverage AI to maintain dominance and the risks of platform shifts that could threaten their positions.

What Time Is The Eclipse Tomorrow

Find out the confirmed time for the solar eclipse happening tomorrow, including viewing details for the UK and other regions. Stay informed with the latest updates.

How to Reduce Heat and Noise in a High-Power AI Workstation

Effective strategies to lower heat and noise in high-power AI workstations, focusing on undervolting, airflow, and component management for quieter, cooler operation.

How We Measured AI Writing Across arXiv, And Where The Measurement Breaks

A new study measures AI-generated content on arXiv, revealing where current metrics succeed and where they fall short in identifying machine-written papers.