← Insights

Mental Models for the AI EconomyProduct Strategy

Roadmapping When the Model Gets Better Every Seven Months

METR found AI task horizons doubling roughly every seven months. How to plan in capability bands, write the test before the feature, and stop building what the next model gives away.

By George MoreasSeptember 6, 20269 min read · interactive

A roadmap is a bet on what you can build and what customers will want. In AI products the first half of that bet moves under you. A feature that is impossible in January can be a weekend project by summer, and a feature you spent a quarter on can become a free checkbox in someone else's model.

There is at least one useful measurement of how fast the ground moves. In March 2025 the research group METR measured the length of software tasks frontier models could finish half the time. The best models managed tasks that take a skilled person about an hour, and that horizon had doubled roughly every seven months for six years. Nobody should treat that as a law. But it is a far better planning assumption than “the model we have now is the model we will have.”

01 / The moving line

When does your feature become possible?

~21 monthsKeep it on the Later list and re-test each model release.
Starts from METR's March 2025 finding: frontier models finished about one-hour software tasks half the time, a horizon that had doubled roughly every seven months. Extrapolating it is a planning assumption, not a forecast.

Three habits that replace the fixed roadmap

Plan in capability bands, not dates. Sort ideas by what they need from the model: works today, works sometimes, needs a model that does not exist yet. The middle band is where most of the product work is: review steps, fallbacks and limits that make a mostly-working model safe to ship. I wrote about that review work in the sign-off bottleneck.

Write the test before the feature. For every “Later” idea, keep a small fixed set of real examples and the answer you need. Run it against each new model release. The week it passes, you know before your competitors do. This is the same discipline as the agent rules in Harness²: capture what good looks like, then let evidence move things.

Ask what survives the next model. If a better model would make your feature trivial for everyone, it is not a moat. Spend your scarce effort on what a model cannot give a competitor: your customers' data, workflow and trust, the argument in When Code Is Cheap, What Still Protects a SaaS?.

02 / Sort the idea

Now, Next, Later — or Rethink

NextBuild the review step and the fallback, then ship behind a flag.
Editorial framework. The key move is the evaluation set: a fixed test that tells you the week a capability becomes good enough.

What I tell product teams

Shorten the horizon you commit to and lengthen the one you watch. Commit to a quarter. Watch eighteen months. Keep the bets small, as in The Best Product Decision Might Be a Smaller Bet, so that when the curve jumps you can move with it instead of finishing a plan that was right a year ago. And remember who decides what is worth building. Models make more things possible; they do not tell you which ones matter. That is still the product manager's job.

Sources

Across the series

Share
Mental Models for the AI Economy

Get the next essay the day it publishes.

A few a month, written from real builds. Unsubscribe in one click.

George Moreas
About the author
George Moreas

Performance marketing and search leader who builds — 15+ years in digital growth and product (AT&T/DirecTV, Microsoft, Employbridge, Site Impact), now running his own properties with AI. These essays are field notes from that loop: what AI actually changes about work, product, and the economics underneath. Based in South Florida.

Keep reading