The five levels ofAI software delivery.

Find where your team sits, and what it takes to reach the next level.

The levels run from a few engineers experimenting with AI to agents that ship on their own. The eight-question self-assessment gives you a level and a next step. Pento delivers client projects at level 4 on Steer by Pento, so you can see what that looks like on your own code.
Illustrative ladder of the five levels of AI software delivery. A marker climbs from level 1, Evangelists, to level 4, Human-assisted, agent-driven, where Steer runs; there a spec, a sandbox, a review on another model and a merge policy light up in turn. Level 5, Autonomous software delivery, stays dashed: Pento stops at level 4 for client work.

What is an AI software delivery maturity model?

An AI software delivery maturity model is a scale for how much of software delivery AI agents do and how much people do, from a few engineers experimenting with AI to agents that deliver software on their own. We use the five levels Cortex set out in The Five Levels of the Enterprise AI Software Factory, described here in our own words: Evangelists, Automations, human-driven and agent-assisted, human-assisted and agent-driven, and autonomous software delivery. Pento delivers client projects at level 4, on Steer by Pento.

Level 4 on Steer, with the work split up
  1. 01Spec
    • YouChoose the merge policy
    • Forward deployed engineersWrite the goal and its acceptance criteria
    • Steer + AI agentsKeep the criteria as a checklist
  2. 02Build
    • Forward deployed engineersSteer a running session with a message
    • Steer + AI agentsBuild in a fresh sandbox, with a budget and a time limit
  3. 03Ask
    • YouAnswer by the deadline, or the default stands
    • Steer + AI agentsBelow 0.70, ask a person instead of acting
  4. 04Review
    • Forward deployed engineersJudge whether the spec was right
    • Steer + AI agentsAttach the evidence: tests and screenshots
    • Review + checksA different model checks every criterion
  5. 05Merge
    • YouApprove what your policy reserves for a person
    • Steer + AI agentsClass the change Low, Data or External risk
    • Review + checksMerge on evidence where the policy allows

Changes requested in review go back to Build.

The five levels

From experiments to autonomous delivery.

Most teams sit at different levels for different kinds of work. Place yourself by how most of your engineering work happens today, not by your best team.
  1. Level 1: Evangelists

    Individuals experiment

    A few engineers try AI on their own: a chat window, a personal copilot, a demo at the all-hands. How the team ships hasn't changed, and nobody measures whether it helps.

    Signs you're here

    • AI use depends on who's on the team
    • Code gets pasted in from chat windows
    • No shared rules for AI-written code

    What gets you to level 2

    Pick one well-understood job and automate it end to end, with an owner.

  2. Level 2: Automations

    Scripts and bots

    AI runs in narrow jobs the team understands well: a CI bot that bumps dependencies, a bot that comments on pull requests, a copilot in a few editors. Each one is useful and separate, and people still write nearly all the code.

    Signs you're here

    • Bots open or comment on pull requests
    • Copilots are licensed, but use varies by team
    • Feature work is still written by hand

    What gets you to level 3

    Give engineers a coding agent in their daily work, with shared conventions for how it's used and reviewed.

  3. Level 3: Human-driven, agent-assisted

    Engineers drive, agents help

    Engineers work with a coding agent in the IDE or terminal and stay at the keyboard: they prompt, watch, and accept or undo each step. Output per engineer goes up, but the agent works only while someone watches it, and review is still line by line.

    Signs you're here

    • Most engineers use an agent every day
    • Agents run on laptops, inside a person's session
    • Every pull request gets the same manual review

    What gets you to level 4

    Write goals with acceptance criteria before agents start, run each agent in its own sandbox, and gate merges by risk.

  4. Level 4: Human-assisted, agent-driven

    Agents execute, people steerWhere Steer by Pento runs

    Agents take feature-sized goals with written acceptance criteria and work them in isolated sandboxes, with a budget and a time limit. People write the specs, steer running sessions, answer questions and approve what the merge policy reserves for them. Every change carries evidence. This is where Steer by Pento runs client work.

    Signs you're here

    • Work starts from a spec with testable acceptance criteria
    • Each agent run gets a fresh sandbox, then it's thrown away
    • A written merge policy decides what needs a person

    Why it matters

    Most of the gain lives here: people spend their time on specs, judgment and approvals instead of typing.

  5. Level 5: Autonomous software delivery

    Agents ship on their own

    Specs go in and production code comes out, with people designing the factory instead of approving its output. Cortex's own framing is that enterprises can't run this way today.

    Signs you're here

    • Agents pick up work from the backlog without a person starting it
    • Changes reach production with no human approval
    • People tune the system, not the changes

    Why we stop at level 4

    Evidence shows a change does what its spec says. Changes that rewrite data or reach outside systems are the ones you can't take back, so on client work Steer keeps a person in the loop for them: every merge policy asks before an external change merges, and the Gated policy asks on data changes too.

Self-assessment

Where does your team sit? Eight questions, two minutes.

Pick the answer closest to how most of your team works today. You get a level, what it means, and the next step we'd recommend.
Question 01 of 08How does most code get written today?
Question 02 of 08Does work start from written acceptance criteria?
Question 03 of 08Where do coding agents run?
Question 04 of 08How long do agents work without a person watching?
Question 05 of 08Who reviews AI-written code before it merges?
Question 06 of 08How are merges gated?
Question 07 of 08What do you measure about AI in delivery?
Question 08 of 08Who owns how AI is used in engineering?

0 of 8 answered.

Scored in your browser. We don't save your answers.

Level 4 on Steer

What level 4 looks like on a real project.

Level 4 is the system around the agent, and on Steer by Pento your team can see every part of it from day one.
  • Goals with acceptance criteria

    Work starts as a goal: feature-sized, with acceptance criteria and a checklist the orchestrator keeps. Agents build against the criteria, and the review checks each one.

  • A fresh sandbox per run

    Each session runs in an isolated sandbox with a budget and a hard time limit, and the sandbox is thrown away when the run ends. A person can steer a running session with a message.

  • A review on a different model

    The review runs on a different model than the coder and returns approve, approve with findings, or request changes, each finding tied to a file, a line and a criterion. A forward deployed engineer judges the result.

  • A merge policy by risk

    Each change is classed Low, Data or External risk, and the policy you choose decides which ones merge on evidence and which ask a person.

Illustrative Steer session at level 4. The agent starts in a fresh sandbox with a time limit, reads goal STR-231 and its three acceptance criteria, edits the orders date filter, passes a test for each criterion, gets an approval from a review on a different model, and the merge policy lets the low-risk change merge on evidence.
Why not level 5

We stop at level 4 on purpose.

For client work, three gates stay in place, and each one is there for a reason.
  • Evidence isn't ownership

    An evidence report proves a change does what its spec says: the tests ran, the screenshots match, the review found nothing. It can't tell you whether the spec was right. A forward deployed engineer judges every change for that.

  • Some changes can't be taken back

    Steer classes every change as Low, Data or External risk. Every merge policy asks a person before an external change merges, the Gated policy asks on data changes too, and a change the review model rates under 0.80 safe always asks.

  • Steer asks when it isn't sure

    Every orchestrator decision carries a probability, and below 0.70 Steer asks a person instead of acting. Questions come with a deadline and a default, so a person stays in the loop without the project stalling.

Read the Evidence Spec →
How we engage

Use level 4 without building it. Two ways in.

Both start with the free audit, which sets the scope and the shape of the team.
Monthly · set by pod size

A team we build for you

Pento forms a pod of forward deployed engineers for your work, for example four engineers or whatever machine learning, software, DevOps and MLOps talent you need. They work with Steer alongside, and the fee depends on the pod's size.

Best for
An ongoing roadmap, a large project such as a migration, or scope that will change as you learn
Who carries the risk
Shared: you set the priorities, and we own how the work is built and the evidence that it's done
Talk to us about a team
One price · a clear scope

A fixed-price project

For integrations and smaller projects you can scope up front. After the free audit we write the scope with you as goals with acceptance criteria and fix the price. Evidence on every pull request shows when each goal is done.

Best for
Integrations and smaller projects with a clear scope. First projects ship in weeks
Who carries the risk
Pento: the price is fixed, so an overrun is ours to absorb
Get a fixed-price quote
How pricing works →
FAQ

The maturity model, answered

Not covered here? Bring the question to a discovery call. An engineer reads every request.

Book a discovery call

Contact us

Want to see level 4 on your own code?

Start with the free audit. It ends with a written quote: a team of forward deployed engineers, or a fixed price for a first project with a clear scope. An engineer reads every request.