The AI agency space has grown fast enough that it's now full of resellers wrapping the same handful of no-code automation templates in different branding. That's not necessarily a scam — for a simple workflow it might even be the right fit — but it's a very different service from custom AI engineering, and the price difference doesn't always reflect that. Here are the questions that reveal which one you're actually talking to.
1. "Will we own the code, prompts, and workflow logic when this is done?"
This is the single most important question. If the answer involves you continuing to pay a monthly fee to the agency's own platform indefinitely to keep the automation running, you don't own anything — you're renting, permanently. Ask specifically whether source code, prompt files, and documentation get transferred to a repository you control.
2. "What happens when the AI is uncertain or wrong?"
A vendor who hasn't thought about this hasn't built a production system before. Listen for specifics: structured output validation, confidence thresholds, human-approval gates for consequential actions. Vague reassurance ("the AI is very accurate") is a red flag — accuracy claims without a described fallback mechanism mean failures will happen live, in front of your customers.
3. "Can you show a system you built handling real production volume, not just a demo?"
Demos are easy. A workflow that reliably handles thousands of real, messy inputs a month is a different engineering problem entirely. Ask for a specific example, even anonymized, of a system running at real volume and what edge cases it had to be hardened against.
4. "How does this integrate with our actual systems — not just the popular ones?"
Plenty of platforms integrate cleanly with the twenty most common SaaS tools and hit a wall the moment your business runs something more specific — a legacy ERP, an internal tool, a niche industry platform. Ask directly whether they build custom API integrations or only support pre-built connectors.
5. "What's the realistic timeline, and what does that timeline actually include?"
Timelines that sound too good often exclude discovery, testing against real edge cases, or production hardening. Ask what happens in each phase and where handoffs occur — a build that's "done" after a single happy-path demo isn't done in any way that matters to your operations.
6. "How is our data handled, and where does it live?"
For anything touching customer data, financials, or internal documents, ask about data retention policy, whether your data is used to train shared models, and what cloud environment (and region, if that matters for your compliance needs) the system runs in.
7. "What does ongoing cost look like after launch?"
Get specific about model usage costs, hosting, and whether there's a recurring platform fee on top of the build cost. A system with true code ownership should have model/infrastructure costs as its main ongoing expense — not a mandatory monthly license to keep using what you paid to build.
8. "Who exactly will be doing the engineering work?"
Some agencies sell the engagement, then hand execution to a rotating pool of subcontractors with no continuity. Ask who your actual point of contact is during and after the build, and what support looks like once the project ships.
9. "What happens if a workflow needs to change six months from now?"
Business processes change. Ask whether modifying the system later requires going back to the original vendor exclusively (a lock-in risk if that relationship sours) or whether, given the code ownership from question one, any competent engineering team could pick it up.
10. "Can I talk to a past client about the actual experience?"
Portfolio pages show outcomes. A reference conversation reveals how communication, timelines, and problem-solving actually went when something didn't work on the first try — which is the real test of any engineering partner.
We're happy to answer every one of these directly and specifically for your situation. Take a look at our own answers on the FAQ page, or book a free 30-minute audit call and ask us all ten yourself.
