All insights

Should you build AI in-house? An honest answer

When to build your AI in-house, when to bring in a partner, and the one test that decides it either way, from someone who sells the second option and will still tell you to build.

Aerial view of a road forking through forest
Photo: Cody Moore / Unsplash

Every founder weighing an AI project asks the same question sooner or later: do we build this ourselves, or bring someone in?

Here is my honest answer, from someone who runs a company that sells the second option and will still tell you when the first one is right. The decision is less about technology than about three things you probably already know about your own team.

Build in-house when all three are true

  • You have an engineer who has already taken an AI system into production, not just built a prototype.
  • The system sits at the core of your product and will need constant change by people who live in your codebase.
  • You have the time. Real, protected time, measured in months, that will not be taken over by the next urgent priority.

If all three hold, build it. You will own the knowledge as well as the code, and that compounds. Your team will understand every decision the system makes, and the next AI feature will be cheaper because of the first.

Be honest about the first point in particular. Building a convincing demo and running a system customers depend on are different skills. Many capable engineers have done the first and not yet the second, and that gap is where most in-house projects lose their quarter.

Bring in a partner when

  • The build would pull your team away from the core product for a quarter or more.
  • Your team can prototype, but has never crossed the reliability gap: tests on real inputs, monitoring, fallbacks and escalation to a person.
  • You need the system working in weeks, because the cost of waiting is real revenue or real hours.
  • You are not sure yet which approach is right: which model, which platform, one agent or several, and you want that decided by someone who has made those calls before.

The last point is underrated. Many founders come to us with an idea rather than a specification. The most valuable early work is often choosing what not to build, and picking the model, the platform and the shape of the system that fit the problem.

Where in-house builds actually stall

The pattern is remarkably consistent. The in-house build starts strong and the demo works. Then it stalls at the reliability step nobody scoped. Three months later there is a prototype nobody trusts with real customers and a team that has lost a quarter of roadmap.

Connecting to a model is the easy part. Any capable engineer can connect to an AI service and produce a good demo in a week. The hard part is the layer around it: knowing when the system is wrong, catching it before a customer does, handling the cases it should not touch, and the judgment about what to leave to people.

What running it involves

Six months after launch, an AI system needs what any production software needs, plus a few things of its own. Someone on your side has to:

  • Watch quality on real traffic and look into the answers that went wrong
  • Keep the test set current as customers find new ways to ask
  • Re-test when the model provider releases a new version or retires an old one
  • Keep costs in check as usage grows
  • Decide which new cases the system may handle, and which stay with people

This is light work when it is planned for. It becomes a burden when nobody owns it, and that is how capable systems quietly decay.

Compare the real costs

Founders usually compare a salary with a project fee. A more useful comparison is the time to a working system, and the product work your team set aside while they were learning.

An in-house build costs the engineers' time, the months before the system is reliable, and the product work that waited in the meantime. A partner engagement costs a scoped fee and some of your team's attention for the decisions only they can make. Neither is automatically cheaper. The right answer depends on how much a quarter of your roadmap is worth, and how sure you are that your team can cross the reliability gap first time.

What a good partner leaves behind

If you do bring someone in, judge them by what remains after they leave. A good engagement should leave you with:

  • The full codebase in your own repository, with no dependency on the partner to keep it running
  • Documentation of how the system works and why the key decisions were made
  • The tests and monitoring, so your team can change it safely
  • A team on your side that has worked alongside the build and can run it from day one

If a partner's model depends on you needing them forever, that is a vendor, and you should know it before you sign.

A hybrid that often works best

For many companies the right answer sits in between. A partner builds the first version with one of your engineers embedded in the work. You get the speed and the experience of a team that has done it before, and your engineer gets the knowledge. By the time the system is live, the ownership has already moved across.

Questions to ask before you decide

  • Has anyone on our team taken an AI system into production before?
  • What would our team not build this quarter if they took this on?
  • How will we know when the system is wrong?
  • Who will run and change it a year from now?

Signs the decision needs revisiting

Whichever way you go, take an honest look after the first six to eight weeks. A few signals tell you it is time to change course:

  • The demo has looked finished for a month, but nobody will put it in front of customers
  • The team cannot say how often the system is wrong
  • Core product work has slipped for two sprints in a row
  • A partner's work arrives without tests or documentation your team can follow

Changing course early costs a few weeks. Changing it after two quarters costs the roadmap, and often the team's confidence in AI as well.

The only question that matters

So: build in-house if you have the person, the fit and the time. Otherwise, buy the speed and keep the ownership. Either way the test is the same. Can your team run it in six months? That is the question that matters.

Put these ideas to work

Every engagement starts with a conversation with our founder, about where AI can change your business.

Talk to us