Skip to content

AI customers

Why Shopify Plus agencies need AI customers

A launch is checked on launch day and judged in the weeks after it. What a Plus agency can’t see once a store goes live, what a missed regression costs in retainers, and a customer-side launch checklist with pass marks.

Shopify Plus agencies need AI customers to keep running the customer side of a Shopify launch checklist after go live, from the welcome email and sign in code to the basket reminder, order emails and old links. A launch or migration is judged in the weeks after it, and an AI customer, with its own inbox, phone number and browser, checks each step through the first 30 days and after every release, keeping what arrived as evidence.

ComparedShopify QA testing options comparedGo straight to the comparison
On this page
  1. How a Shopify Plus agency makes money
  2. What a Plus agency can’t see after launch
  3. What a missed regression costs a Plus agency
  4. The Shopify launch checklist, from the customer’s side
  5. What AI customers do for a Plus agency
  6. What changes on Shopify in 2026 and 2027
  7. Shopify QA testing options comparedCompared
  8. When a Plus agency doesn’t need AI customers
  9. Start this week
  10. Questions about Shopify launch checklists

Shopify Plus agencies design, build and migrate stores on Shopify Plus, Shopify’s plan for larger brands, then support them on monthly retainers. AI customers give the agency’s delivery and support teams a standing view of each client store as a new customer receives it, from launch day onward. What AI customers are defines the term, and why every company needs AI customers makes the wider case.

At Flux, a Plus agency, most clients move to a monthly retainer after launch, so the first weeks after launch are also the first weeks of the retainer.

How a Shopify Plus agency makes money

The work is often sold in 2 parts. Flux starts each project with a paid discovery phase and scopes every build as a fixed price engagement. Ringly’s 2026 guide for merchants hiring a Plus partner puts a lean Plus migration at $25,000 to $50,000, a mid range build at $40,000 to $80,000 and a full Plus implementation at $50,000 to $250,000 or more. Ringly’s tiers depend on checkout, B2B and international scope.

Retainers carry the business after launch. Ringly’s guide sets them at $2,700 to $5,000 a month for a fractional team doing light ongoing work, $10,000 to $15,000 for a standard Plus retainer and $20,000 to $30,000 for enterprise work across several streams. Tenten’s January 2026 pricing guide lists Plus tier partners at $200 to $400 an hour and tells merchants to budget $500 to $2,000 a month for post launch support.

$120,000 to $180,000

a year from one standard Shopify Plus retainer, at $10,000 to $15,000 a month

Ringly, 2026 guide to hiring a Plus partnerringly.io

The week runs on releases. Mgroup, a Plus support agency, describes a retainer with weekly releases and QA, regression testing (checking that what worked still works after a change) by QA and release specialists, and monthly reports that tie hours to outcomes. 1Digital’s September 2026 guide puts a growing Plus merchant at 40 to 80 support hours a month, with critical issues answered within 1 business hour on its Plus tier.

Black Friday is on Friday 27 November 2026, and Mgroup freezes theme and app updates for a peak readiness pass before it. A code freeze 2 weeks out falls on Friday 13 November. Ringly’s guide tells merchants to ask an agency to “Show me three live stores you built that look like mine” and to get its post launch SLA in writing, so every store an agency has launched is part of its next pitch.

What a Plus agency can’t see after launch

The go/no-go call before launch checks the store from inside the project: the theme on real devices, the checkout up to payment, layout diffs and a test order. The problems that reach the client tend to come later, from the customer’s side, once the launch team has moved on.

The launch itself is rarely where the damage happens. It shows up in week three, when organic traffic is down and nobody knows which pages lost it, or in month four, when finance notices that orders and the ERP stopped agreeing.

Joe McFerrin, CEO of IWD Agency, in its September 2026 migration checklist
  • Returning customers’ sign in. Shopify’s help centre says customer passwords can’t be migrated from another store by CSV, and with sign in links turned on, Shopify’s customer accounts send a one time 6 digit code by email instead of asking for a password. Either way, a returning customer’s first visit depends on an email arriving.
  • Flows rebuilt for the new store. IWD notes that shopping feeds, marketplace listings and automated email flows are “easy to rebuild at launch and easy to forget afterwards”. Klaviyo’s own 2026 benchmarks show flows earning nearly 41% of email revenue from 5.3% of sends.
  • The sender. Shopify’s help centre says Gmail and Yahoo require an authenticated domain with a DMARC record for email from a branded address, and that if the new store’s domain isn’t authenticated, Shopify rewrites the sender to an address at shopifyemail.com.
  • Regressions after later releases. In an August 2026 Shopify Community thread on how agencies test stores after releases, one reply named the rework it sees most often as “regressions that get reintroduced a few weeks later because there’s no ongoing regression suite”, found when a customer complains.
  • Tracking. Niblin’s guide to Plus checkout tracking, updated in May 2026, says that after Shopify retired checkout.liquid, “most merchants didn’t realize their tracking had broken until weeks or months of data were already lost”.
  • Live payments. Shopify’s help centre says customers can’t place live orders while payment providers are in test mode, so proving a live store’s order emails takes a real order, cancelled and refunded.

Each of these first shows in a customer’s inbox, phone or browser. A Shopify website launch checklist ends at go live, and after it nobody on the account is a new customer of the store.

What a missed regression costs a Plus agency

1 client kept is worth its monthly retainer × the months it stays, both from your agency’s own books. At Ringly’s rates, a light retainer of $2,700 a month is worth $8,100 over 3 months, $16,200 over 6 and $32,400 over 12. A standard Plus retainer of $15,000 a month is worth $45,000, $90,000 and $180,000.

The client’s side of the sum is the revenue a day of the broken step × the days it goes unnoticed, which average half the gap between checks: about 15 days with a monthly review, 3.5 with a weekly check and half a day with a daily one. How AI customers find revenue leaks works it from a flow report.

Running the checklist by hand has its own cost. For an invented agency with 10 support clients releasing weekly and 6 launches a year, each followed by hypercare (the weeks of close support after a launch), the customer-side checklist by hand takes 353 hours a year at example timings. At the US median wage for software quality assurance analysts and testers, $104,300 a year in May 2025, or $50.14 an hour, that is $17,699. The hours pay for themselves if the routine keeps 1 standard Plus client for about 5 more weeks, or a light retainer for 6.6 more months.

ExampleThe payback worked once for an invented agency with example timings. The hourly rate is the BLS median for QA analysts and testers, and the retainers are from Ringly’s guide. Put your own numbers in each row.

Sold as a care plan line, the same routine sits inside the $500 to $2,000 a month that Tenten’s guide tells merchants to budget for post launch support. Put any tool’s yearly price in place of the hours: AI customers at scale prices an AI customer line by line at published retail prices.

The Shopify launch checklist, from the customer’s side

The checklist has 10 checks, each with a pass mark written before launch and an owner for a fail. Run every check on a phone, in a private window, logged out of the admin, from an email address and phone number the store has never seen. By hand, the hours are checks × stores × minutes × how often.

CheckPass markWhenOwner of a fail
Sign up and welcomeWelcome within 5 minutes, with the pop up’s codeLaunch day, daily to day 7, after form editsEmail lead or retention agency
Account sign inSign in code within 1 minute, order history shownLaunch day, daily to day 7, after theme changesDeveloper
Discount codesEach live code applies or is refused as set, sale items tooLaunch day, after every discount changeDeveloperEcommerce lead
Basket and checkout remindersWithin the flow’s delay plus 1 hour, product and price shownLaunch day, weekly, after app changesEmail lead
Order and shipping emailsSent from the brand’s own domain, tracking link opensLaunch day on a funded card, then weeklyDeveloper
Old URLs and email links1 permanent redirect each, to a live pageLaunch day, then the top 20 weeklyDeveloperSEO lead
Consent and textsOpt in brings the confirmation text, STOP stops textsLaunch day, after SMS app changesRetention lead
Tracking and the cookie bannerPurchase pixels fire on a test order, none after rejectLaunch day, after checkout changesDeveloper
The chatbotReturns, delivery and order status match the new policiesLaunch day, after policy or prompt editsCX lead
AI shopping agents and answersPrice, stock and returns match the storeWeek 1, then monthlyOwner of the product feed
The customer-side Shopify launch checklist. Example pass marks and owners: set each from the client’s own flows, policies and team

On a store still on legacy customer accounts, the sign in check is the password reset email. On Shopify, a checkout counts as abandoned once it stays incomplete for more than 10 minutes after the shopper gives an email, so the checkout reminder’s deadline starts there. A Shopify redirect works only from a broken URL, and IWD puts checking the old site’s top 200 landing pages at an afternoon’s work. Why a welcome or basket email never arrives lists the causes of a failed flow, and the Black Friday checklist adds the sale week tests.

At example timings, a full run takes about 2 hours, plus an afternoon of about 4 hours for redirects on launch day, and a short run of the first 4 checks about 30 minutes. Hypercare then comes to about 15.5 hours a store: the full run and redirects on launch day, a short run each day to day 7, and full runs on days 14, 21 and 30. The hours grow faster than the client list:

  • Every run needs a new identity. A welcome email comes once per address and a text confirmation once per number, so 10 stores checked weekly need 520 new addresses a year.
  • The waits are long. A basket reminder set for 1 hour still needs watching for a day, and a sign in code needs someone at the inbox when it lands.
  • The order check costs money. Each run needs a real order on a funded card, then a refund.
  • Changes arrive between releases. App updates, a client’s own flow edits and Shopify’s platform changes can each stop a step on a day nobody checks.

A team that runs this as a routine is practising customer-side observability. Customer-side observability is seeing what a company does to its customers by being one of them: every email, text, price, page, checkout and AI answer it sends, kept over time with evidence anyone can check. For a Plus agency it rests on pass marks written before launch, a cadence tied to launches and releases, and a named owner for each fail. 1Digital’s guide says retainers that cover only reactive support “function like insurance”. A retainer that runs this routine shows the client, every week, what its customers received.

What AI customers do for a Plus agency

An AI customer is an AI agent that becomes a real customer of a company, with its own inbox, phone number and browser, and keeps what the company sends and shows it as evidence.

For a Plus agency, each client store gets its own AI customers, with the client’s OK, from launch day onward. They run the checklist on the cadence the agency sets and keep every email, text and page exactly as it arrived, each email’s DKIM signature checked on arrival and kept with its key.

JobThe checkA passThat week
Launch day and hypercare: Delivery monitoringEvery email, text, login code and link from launch day, for 14 daysEvery email, text and code inside its pass markEach fail sent to its owner, then run again
Every release: Website auditSign up, sign in code, a code and checkout after each deployA pass for every step, minutes after the releaseFixed or rolled back before the client sees it
Before and after cutover: Mystery shopperThe same journeys run on the old store, then on the new oneThe new store sends everything the old one didMissing flows rebuilt before hypercare ends
Partner and affiliate links: Partner checksEach partner’s link followed to the store, its code tried in the basketEvery link lands on a live page and every code appliesA note to each partner with the new link
The agency’s monthly client reportEach store’s results for the month, with the evidence linkedEvery check passed, or each fail with its fix dateSent with the hours report, before the quarterly review
The jobs AI customers do for a Plus agency, with the recipe that runs each one

Obsession makes the first AI customers that work for you: they sign up to any company you name and stay its customer for months, keeping every email, offer and price it sends, with proof. A deploy hook, a schedule or a button starts each run, and a preview link runs every journey on a new theme before it goes live. AI customers say they are AI whenever they talk to a person, never use fake payment details, and place a real order only on a card the client or the agency funds.

What changes on Shopify in 2026 and 2027

  • Live: discount logic has moved to Functions. Shopify Scripts stopped executing on 30 June 2026, after editing closed on 15 April, and their logic moves to Shopify Functions, which Shopify is extending for discounts, shipping and payments. Every rebuilt discount needs testing at checkout as a customer.
  • Live: tracking has moved to pixels. Shopify sunset checkout.liquid and additional scripts on Plus stores’ Thank you and Order status pages on 28 August 2025, and script tags on non-Plus stores’ pages on 26 August 2026. Its help centre tells merchants to use app pixels to continue tracking customer events.
  • Announced: legacy customer accounts are going. Shopify deprecated legacy customer accounts on 26 February 2026 and will announce a final sunset date later in 2026. A store on legacy accounts that moves to a theme without the legacy files moves to the new customer accounts, so its sign in emails change.
  • Live: AI channels on by default. Shopify’s agentic storefronts, which let customers discover a store’s products in ChatGPT, Google AI Mode and Gemini, Microsoft Copilot and Meta, are active by default for eligible stores that accept Shopify’s agentic storefronts terms. Channels are managed under Sales channels, then Agentic.
  • Forecast: more shoppers arrive through AI. Adobe forecasts that traffic from AI services to US retail sites, measured by shoppers clicking a link, will rise 130% year over year over the 2026 holiday season, with Black Friday up 95%.

Each change can stop a step a customer depends on without an alert reaching the agency. AI customers repeat the checks after each platform change and each release, so a code refused after a Functions rebuild is found the week it starts. Agentic commerce for merchants sets out the readiness test for AI shopping agents, and what ChatGPT says about your store the check of AI answers.

Shopify QA testing options compared

Obsession makes AI customers, so every other option is described from its provider’s own pages as of 24 October 2026.

OptionWhat it does wellPriceWhere it stopsBest for
Doing nothingCosts no timeFreeThe client or a customer finds each breakStores that rarely change after launch
By handthe checklist, a new address, a phone and a sheetEvery check, with the team’s judgementYour team’s hoursUS median for QA testers: $104,300 a yearHours grow with every store, release and waitLaunch day at 1 or 2 stores
Your own test suitePlaywrightScripted tests in Chromium, Firefox and WebKit, in CIFree, Apache 2.0 licenceEngineering timeEmail and texts need a separate inbox serviceCode regressions before a release
Scripted browser testsGhost InspectorAutomated browser tests on a schedule, email testing on higher plans$109, $225 or $449 a month, billed annuallyRuns the tests the team writes and maintainsCheckout paths across many stores
Email and SMS test inboxesMailosaurEmail and SMS received inside automated testsPersonal: from $20 a month, billed annuallyCore: from $50 a month, billed annuallySMS and authentication: from $37.50 a monthEach journey and wait is scripted by the teamAccount emails in a test suite
Shopify monitoring appCheckout DoctorCheckout, discounts and shipping tested in a real browser on a scheduleFree health checkPaid: $29, $79 or $199 a monthNever places an order, with no email checks describedCheckout between releases, several stores on Pro
SEO crawlerScreaming FrogFinds broken links, errors and redirectsFree to 500 URLs£199 a year per licenceReads pages, with no sign up, order or emailRedirect checks at launch
ObsessionOursWebsite audit, Mystery shopper, Delivery monitoring, Partner checksAI customers of each client store from launch day, every email, text and code kept as evidenceNot listedFirst store check freeStops at bot walls and CAPTCHAsAgencies with launches and support retainers
Ways a Plus agency can check a client store after launch. Prices from each provider’s own pages, 24 October 2026. Checkout Doctor bills every 30 days

The options combine. A test suite catches code regressions before a release, a crawler checks redirects at launch, a monitoring app watches checkout between releases, and AI customers record what each new customer of the store received. For an audit of a store’s own data as well, use the Shopify store audit checklist.

When a Plus agency doesn’t need AI customers

  • Builds handed over at launch. An agency that keeps no support retainer runs the checklist by hand on launch day and passes it to the client’s team.
  • Code regressions before a release. A test suite in CI on a preview store catches them before any customer meets them, at the cost of engineering time.
  • Uptime at every hour. A scripted monitor alerts within minutes when a page or the cart goes down.
  • Stores that rarely change, with few releases and no email or text programme of their own. A monthly run by hand covers them.
  • A client that hasn’t agreed to tests on its store. Put the OK in the statement of work before launch.

Start this week

  1. List every client store with a launch, migration or release planned before a freeze on Friday 13 November, 2 weeks before Black Friday.
  2. Copy the checklist into each store’s launch plan, with a pass mark from the client’s own flows and an owner for every row.
  3. Before cutover, run the sign up, basket and order journeys on the old store and keep what arrives, then run the same journeys on launch day.
  4. Pull the old site’s top 200 landing pages and every link in the last 3 months of emails, and check each returns 1 permanent redirect to a live page.
  5. Add a page called “What a new customer received” to each support client’s monthly report, with every email linked as it arrived.

Questions about Shopify launch checklists

The store’s settings, checkout, payments and redirects, then the customer’s side: sign up and welcome, account sign in, discount codes, basket and checkout reminders, order and shipping emails, consent and texts, tracking, the chatbot and what AI shopping agents read. Each check needs a pass mark and an owner.

A Shopify go live checklist is the set of checks run on launch day, before and after the store opens to customers. Its customer-side checks should run again through the first 30 days, because problems often appear in the weeks after launch.

Settings, payments, shipping, taxes, notifications, the sending domain, redirects and apps, then a test order and a sign up from a new address. Customers can’t place live orders while payment providers are in test mode, so turn test mode off before launch.

Run a short customer-side check after every release: sign up from a new address, sign in, apply a live code and leave a basket, then confirm each email and text arrives inside its pass mark. A test suite and screenshot diffs cover the code and the layout.

The parts a customer meets after launch: returning customers’ sign in, because passwords can’t be migrated by CSV, old URLs without redirects, email flows rebuilt for the new store, the sending domain, tracking and discount logic. Check each from a new customer’s side on launch day and through the first 30 days.

It designs, builds and migrates stores on Shopify Plus, often after a paid discovery and for a fixed price, then supports them on a monthly retainer. Ringly’s 2026 guide puts a standard Plus retainer at $10,000 to $15,000 a month.

ShareLinkedInX

Sources

In the order the article cites them. Every link was checked on 24 Oct 2026.

  1. Shopify Plus Agency for Development & AI SearchFlux
  2. Shopify Plus partner agency: how to vet, hire, and budget for one in 2026Ringly
  3. Shopify Agency Pricing 2026: Project Costs & Retainer ModelsTenten, 11 Jan 2026
  4. Shopify Plus Support & Maintenance ServicesMgroup
  5. What Every Shopify Support Retainer Should Cover (And What Plus Merchants Specifically Need)1Digital Agency, 7 Sep 2026
  6. Ecommerce Migration Checklist: Your First Year After a ReplatformIWD Agency (Joe McFerrin), 24 Sep 2026
  7. Importing and exporting customer listsShopify Help Center
  8. Customer accountsShopify Help Center
  9. Email marketing benchmarks by Industry 2026Klaviyo, 2026
  10. Setting up your emailShopify Help Center
  11. Shopify agencies in Singapore/SEA: how do you test stores after releases?Shopify Community, 30 Aug 2026
  12. Shopify Plus Checkout Tracking Is Broken: Here’s What Happened and How to Fix ItNiblin, 25 May 2026
  13. Placing a test orderShopify Help Center
  14. Software Developers, Quality Assurance Analysts, and Testers: Occupational Outlook HandbookUS Bureau of Labor Statistics
  15. Recovering abandoned checkoutsShopify Help Center
  16. Creating and managing URL redirectsShopify Help Center
  17. Shopify Scripts will be deprecated on June 30, 2026Shopify developer changelog, 9 Apr 2026
  18. checkout.liquidShopify Dev Docs
  19. Non-Plus - Upgrading and replacing your Thank you and Order status pagesShopify Help Center
  20. Legacy customer accounts are now deprecatedShopify developer changelog, 26 Feb 2026
  21. Shopify agentic storefrontsShopify Help Center
  22. Adobe: U.S. Holiday Shopping Season to Hit Record $275.1 Billion Online, Rising 6.7% YoYAdobe, 28 Sep 2026
  23. microsoft/playwrightGitHub
  24. PricingGhost Inspector
  25. Simple, predictable pricingMailosaur
  26. Checkout Doctor: Store AlertsShopify App Store
  27. PricingScreaming Frog

Recipes for this

Send AI customers to every company on your list.

Join the waitlist and tell us the first job to set up. We confirm the plan with you before anything runs.

Join the waitlist, then name up to 5 client stores to start with.

We keep what you tell us to set up your spot and email you about Obsession. Privacy notice