Why Shopify Plus agencies need AI customers
A launch is checked on launch day and judged in the weeks after it. What a Plus agency can’t see once a store goes live, what a missed regression costs in retainers, and a customer-side launch checklist with pass marks.
The store’s AI customer, from launch day to day 30
- Day 0Launch checks passSign up, code, basket and checkout on a phone
- Day 1Welcome email arrives3 minutes after sign up, WREN10 works
- Day 4Sign in code never arrivesSigning in again, nothing in 15 minutes
- Day 9Old email link returns 404/sale.html from a June email, no redirect
- Day 16Basket reminder stopsNone in 24 hours, after release 3.4
- Day 17Fix ships, reminder returns1 hour 4 minutes after the basket
An example on an invented store. The agency’s launch checklist passed on day 0, and the store’s reports showed every flow live.
Shopify Plus agencies need AI customers to keep running the customer side of a Shopify launch checklist after go live, from the welcome email and sign in code to the basket reminder, order emails and old links. A launch or migration is judged in the weeks after it, and an AI customer, with its own inbox, phone number and browser, checks each step through the first 30 days and after every release, keeping what arrived as evidence.
ComparedShopify QA testing options comparedGo straight to the comparisonOn this page
- How a Shopify Plus agency makes money
- What a Plus agency can’t see after launch
- What a missed regression costs a Plus agency
- The Shopify launch checklist, from the customer’s side
- What AI customers do for a Plus agency
- What changes on Shopify in 2026 and 2027
- Shopify QA testing options comparedCompared
- When a Plus agency doesn’t need AI customers
- Start this week
- Questions about Shopify launch checklists
Shopify Plus agencies design, build and migrate stores on Shopify Plus, Shopify’s plan for larger brands, then support them on monthly retainers. AI customers give the agency’s delivery and support teams a standing view of each client store as a new customer receives it, from launch day onward. What AI customers are defines the term, and why every company needs AI customers makes the wider case.
At Flux, a Plus agency, most clients move to a monthly retainer after launch, so the first weeks after launch are also the first weeks of the retainer.
How a Shopify Plus agency makes money
The work is often sold in 2 parts. Flux starts each project with a paid discovery phase and scopes every build as a fixed price engagement. Ringly’s 2026 guide for merchants hiring a Plus partner puts a lean Plus migration at $25,000 to $50,000, a mid range build at $40,000 to $80,000 and a full Plus implementation at $50,000 to $250,000 or more. Ringly’s tiers depend on checkout, B2B and international scope.
Retainers carry the business after launch. Ringly’s guide sets them at $2,700 to $5,000 a month for a fractional team doing light ongoing work, $10,000 to $15,000 for a standard Plus retainer and $20,000 to $30,000 for enterprise work across several streams. Tenten’s January 2026 pricing guide lists Plus tier partners at $200 to $400 an hour and tells merchants to budget $500 to $2,000 a month for post launch support.
$120,000 to $180,000
a year from one standard Shopify Plus retainer, at $10,000 to $15,000 a month
Ringly, 2026 guide to hiring a Plus partnerringly.ioThe week runs on releases. Mgroup, a Plus support agency, describes a retainer with weekly releases and QA, regression testing (checking that what worked still works after a change) by QA and release specialists, and monthly reports that tie hours to outcomes. 1Digital’s September 2026 guide puts a growing Plus merchant at 40 to 80 support hours a month, with critical issues answered within 1 business hour on its Plus tier.
Black Friday is on Friday 27 November 2026, and Mgroup freezes theme and app updates for a peak readiness pass before it. A code freeze 2 weeks out falls on Friday 13 November. Ringly’s guide tells merchants to ask an agency to “Show me three live stores you built that look like mine” and to get its post launch SLA in writing, so every store an agency has launched is part of its next pitch.
What a Plus agency can’t see after launch
The go/no-go call before launch checks the store from inside the project: the theme on real devices, the checkout up to payment, layout diffs and a test order. The problems that reach the client tend to come later, from the customer’s side, once the launch team has moved on.
The launch itself is rarely where the damage happens. It shows up in week three, when organic traffic is down and nobody knows which pages lost it, or in month four, when finance notices that orders and the ERP stopped agreeing.
- Returning customers’ sign in. Shopify’s help centre says customer passwords can’t be migrated from another store by CSV, and with sign in links turned on, Shopify’s customer accounts send a one time 6 digit code by email instead of asking for a password. Either way, a returning customer’s first visit depends on an email arriving.
- Flows rebuilt for the new store. IWD notes that shopping feeds, marketplace listings and automated email flows are “easy to rebuild at launch and easy to forget afterwards”. Klaviyo’s own 2026 benchmarks show flows earning nearly 41% of email revenue from 5.3% of sends.
- The sender. Shopify’s help centre says Gmail and Yahoo require an authenticated domain with a DMARC record for email from a branded address, and that if the new store’s domain isn’t authenticated, Shopify rewrites the sender to an address at shopifyemail.com.
- Regressions after later releases. In an August 2026 Shopify Community thread on how agencies test stores after releases, one reply named the rework it sees most often as “regressions that get reintroduced a few weeks later because there’s no ongoing regression suite”, found when a customer complains.
- Tracking. Niblin’s guide to Plus checkout tracking, updated in May 2026, says that after Shopify retired checkout.liquid, “most merchants didn’t realize their tracking had broken until weeks or months of data were already lost”.
- Live payments. Shopify’s help centre says customers can’t place live orders while payment providers are in test mode, so proving a live store’s order emails takes a real order, cancelled and refunded.
Each of these first shows in a customer’s inbox, phone or browser. A Shopify website launch checklist ends at go live, and after it nobody on the account is a new customer of the store.
What a missed regression costs a Plus agency
1 client kept is worth its monthly retainer × the months it stays, both from your agency’s own books. At Ringly’s rates, a light retainer of $2,700 a month is worth $8,100 over 3 months, $16,200 over 6 and $32,400 over 12. A standard Plus retainer of $15,000 a month is worth $45,000, $90,000 and $180,000.
The client’s side of the sum is the revenue a day of the broken step × the days it goes unnoticed, which average half the gap between checks: about 15 days with a monthly review, 3.5 with a weekly check and half a day with a daily one. How AI customers find revenue leaks works it from a flow report.
Running the checklist by hand has its own cost. For an invented agency with 10 support clients releasing weekly and 6 launches a year, each followed by hypercare (the weeks of close support after a launch), the customer-side checklist by hand takes 353 hours a year at example timings. At the US median wage for software quality assurance analysts and testers, $104,300 a year in May 2025, or $50.14 an hour, that is $17,699. The hours pay for themselves if the routine keeps 1 standard Plus client for about 5 more weeks, or a light retainer for 6.6 more months.
- Short run after each release4 checks, every weekly release
- 30 minutes
- 10 support clients, a year0.5 hours × 10 × 52
- 260 hours
- Hypercare, 6 launches15.5 hours a launch
- 93 hours
- Cost of 353 hours× $50.14, the BLS median for QA testers
- $17,699
- 1 client, high caseA month, a standard Plus retainer
- $15,000
- 1 client, low caseA month, a light retainer
- $2,700
- Months of 1 client that cover it$17,699 ÷ each retainer
- 1.2 to 6.6
Sold as a care plan line, the same routine sits inside the $500 to $2,000 a month that Tenten’s guide tells merchants to budget for post launch support. Put any tool’s yearly price in place of the hours: AI customers at scale prices an AI customer line by line at published retail prices.
The Shopify launch checklist, from the customer’s side
The checklist has 10 checks, each with a pass mark written before launch and an owner for a fail. Run every check on a phone, in a private window, logged out of the admin, from an email address and phone number the store has never seen. By hand, the hours are checks × stores × minutes × how often.
| Check | Pass mark | When | Owner of a fail |
|---|---|---|---|
| Sign up and welcome | Welcome within 5 minutes, with the pop up’s code | Launch day, daily to day 7, after form edits | Email lead or retention agency |
| Account sign in | Sign in code within 1 minute, order history shown | Launch day, daily to day 7, after theme changes | Developer |
| Discount codes | Each live code applies or is refused as set, sale items too | Launch day, after every discount change | DeveloperEcommerce lead |
| Basket and checkout reminders | Within the flow’s delay plus 1 hour, product and price shown | Launch day, weekly, after app changes | Email lead |
| Order and shipping emails | Sent from the brand’s own domain, tracking link opens | Launch day on a funded card, then weekly | Developer |
| Old URLs and email links | 1 permanent redirect each, to a live page | Launch day, then the top 20 weekly | DeveloperSEO lead |
| Consent and texts | Opt in brings the confirmation text, STOP stops texts | Launch day, after SMS app changes | Retention lead |
| Tracking and the cookie banner | Purchase pixels fire on a test order, none after reject | Launch day, after checkout changes | Developer |
| The chatbot | Returns, delivery and order status match the new policies | Launch day, after policy or prompt edits | CX lead |
| AI shopping agents and answers | Price, stock and returns match the store | Week 1, then monthly | Owner of the product feed |
On a store still on legacy customer accounts, the sign in check is the password reset email. On Shopify, a checkout counts as abandoned once it stays incomplete for more than 10 minutes after the shopper gives an email, so the checkout reminder’s deadline starts there. A Shopify redirect works only from a broken URL, and IWD puts checking the old site’s top 200 landing pages at an afternoon’s work. Why a welcome or basket email never arrives lists the causes of a failed flow, and the Black Friday checklist adds the sale week tests.
At example timings, a full run takes about 2 hours, plus an afternoon of about 4 hours for redirects on launch day, and a short run of the first 4 checks about 30 minutes. Hypercare then comes to about 15.5 hours a store: the full run and redirects on launch day, a short run each day to day 7, and full runs on days 14, 21 and 30. The hours grow faster than the client list:
- Every run needs a new identity. A welcome email comes once per address and a text confirmation once per number, so 10 stores checked weekly need 520 new addresses a year.
- The waits are long. A basket reminder set for 1 hour still needs watching for a day, and a sign in code needs someone at the inbox when it lands.
- The order check costs money. Each run needs a real order on a funded card, then a refund.
- Changes arrive between releases. App updates, a client’s own flow edits and Shopify’s platform changes can each stop a step on a day nobody checks.
A team that runs this as a routine is practising customer-side observability. Customer-side observability is seeing what a company does to its customers by being one of them: every email, text, price, page, checkout and AI answer it sends, kept over time with evidence anyone can check. For a Plus agency it rests on pass marks written before launch, a cadence tied to launches and releases, and a named owner for each fail. 1Digital’s guide says retainers that cover only reactive support “function like insurance”. A retainer that runs this routine shows the client, every week, what its customers received.
What AI customers do for a Plus agency
An AI customer is an AI agent that becomes a real customer of a company, with its own inbox, phone number and browser, and keeps what the company sends and shows it as evidence.
For a Plus agency, each client store gets its own AI customers, with the client’s OK, from launch day onward. They run the checklist on the cadence the agency sets and keep every email, text and page exactly as it arrived, each email’s DKIM signature checked on arrival and kept with its key.
| Job | The check | A pass | That week |
|---|---|---|---|
| Launch day and hypercare: Delivery monitoring | Every email, text, login code and link from launch day, for 14 days | Every email, text and code inside its pass mark | Each fail sent to its owner, then run again |
| Every release: Website audit | Sign up, sign in code, a code and checkout after each deploy | A pass for every step, minutes after the release | Fixed or rolled back before the client sees it |
| Before and after cutover: Mystery shopper | The same journeys run on the old store, then on the new one | The new store sends everything the old one did | Missing flows rebuilt before hypercare ends |
| Partner and affiliate links: Partner checks | Each partner’s link followed to the store, its code tried in the basket | Every link lands on a live page and every code applies | A note to each partner with the new link |
| The agency’s monthly client report | Each store’s results for the month, with the evidence linked | Every check passed, or each fail with its fix date | Sent with the hours report, before the quarterly review |
Obsession makes the first AI customers that work for you: they sign up to any company you name and stay its customer for months, keeping every email, offer and price it sends, with proof. A deploy hook, a schedule or a button starts each run, and a preview link runs every journey on a new theme before it goes live. AI customers say they are AI whenever they talk to a person, never use fake payment details, and place a real order only on a card the client or the agency funds.
What changes on Shopify in 2026 and 2027
- Live: discount logic has moved to Functions. Shopify Scripts stopped executing on 30 June 2026, after editing closed on 15 April, and their logic moves to Shopify Functions, which Shopify is extending for discounts, shipping and payments. Every rebuilt discount needs testing at checkout as a customer.
- Live: tracking has moved to pixels. Shopify sunset checkout.liquid and additional scripts on Plus stores’ Thank you and Order status pages on 28 August 2025, and script tags on non-Plus stores’ pages on 26 August 2026. Its help centre tells merchants to use app pixels to continue tracking customer events.
- Announced: legacy customer accounts are going. Shopify deprecated legacy customer accounts on 26 February 2026 and will announce a final sunset date later in 2026. A store on legacy accounts that moves to a theme without the legacy files moves to the new customer accounts, so its sign in emails change.
- Live: AI channels on by default. Shopify’s agentic storefronts, which let customers discover a store’s products in ChatGPT, Google AI Mode and Gemini, Microsoft Copilot and Meta, are active by default for eligible stores that accept Shopify’s agentic storefronts terms. Channels are managed under Sales channels, then Agentic.
- Forecast: more shoppers arrive through AI. Adobe forecasts that traffic from AI services to US retail sites, measured by shoppers clicking a link, will rise 130% year over year over the 2026 holiday season, with Black Friday up 95%.
Each change can stop a step a customer depends on without an alert reaching the agency. AI customers repeat the checks after each platform change and each release, so a code refused after a Functions rebuild is found the week it starts. Agentic commerce for merchants sets out the readiness test for AI shopping agents, and what ChatGPT says about your store the check of AI answers.
Shopify QA testing options compared
Obsession makes AI customers, so every other option is described from its provider’s own pages as of 24 October 2026.
| Option | What it does well | Price | Where it stops | Best for |
|---|---|---|---|---|
| Doing nothing | Costs no time | Free | The client or a customer finds each break | Stores that rarely change after launch |
| By handthe checklist, a new address, a phone and a sheet | Every check, with the team’s judgement | Your team’s hoursUS median for QA testers: $104,300 a year | Hours grow with every store, release and wait | Launch day at 1 or 2 stores |
| Your own test suitePlaywright | Scripted tests in Chromium, Firefox and WebKit, in CI | Free, Apache 2.0 licenceEngineering time | Email and texts need a separate inbox service | Code regressions before a release |
| Scripted browser testsGhost Inspector | Automated browser tests on a schedule, email testing on higher plans | $109, $225 or $449 a month, billed annually | Runs the tests the team writes and maintains | Checkout paths across many stores |
| Email and SMS test inboxesMailosaur | Email and SMS received inside automated tests | Personal: from $20 a month, billed annuallyCore: from $50 a month, billed annuallySMS and authentication: from $37.50 a month | Each journey and wait is scripted by the team | Account emails in a test suite |
| Shopify monitoring appCheckout Doctor | Checkout, discounts and shipping tested in a real browser on a schedule | Free health checkPaid: $29, $79 or $199 a month | Never places an order, with no email checks described | Checkout between releases, several stores on Pro |
| SEO crawlerScreaming Frog | Finds broken links, errors and redirects | Free to 500 URLs£199 a year per licence | Reads pages, with no sign up, order or email | Redirect checks at launch |
| ObsessionOursWebsite audit, Mystery shopper, Delivery monitoring, Partner checks | AI customers of each client store from launch day, every email, text and code kept as evidence | Not listedFirst store check free | Stops at bot walls and CAPTCHAs | Agencies with launches and support retainers |
The options combine. A test suite catches code regressions before a release, a crawler checks redirects at launch, a monitoring app watches checkout between releases, and AI customers record what each new customer of the store received. For an audit of a store’s own data as well, use the Shopify store audit checklist.
When a Plus agency doesn’t need AI customers
- Builds handed over at launch. An agency that keeps no support retainer runs the checklist by hand on launch day and passes it to the client’s team.
- Code regressions before a release. A test suite in CI on a preview store catches them before any customer meets them, at the cost of engineering time.
- Uptime at every hour. A scripted monitor alerts within minutes when a page or the cart goes down.
- Stores that rarely change, with few releases and no email or text programme of their own. A monthly run by hand covers them.
- A client that hasn’t agreed to tests on its store. Put the OK in the statement of work before launch.
Start this week
- List every client store with a launch, migration or release planned before a freeze on Friday 13 November, 2 weeks before Black Friday.
- Copy the checklist into each store’s launch plan, with a pass mark from the client’s own flows and an owner for every row.
- Before cutover, run the sign up, basket and order journeys on the old store and keep what arrives, then run the same journeys on launch day.
- Pull the old site’s top 200 landing pages and every link in the last 3 months of emails, and check each returns 1 permanent redirect to a live page.
- Add a page called “What a new customer received” to each support client’s monthly report, with every email linked as it arrived.
Questions about Shopify launch checklists
The store’s settings, checkout, payments and redirects, then the customer’s side: sign up and welcome, account sign in, discount codes, basket and checkout reminders, order and shipping emails, consent and texts, tracking, the chatbot and what AI shopping agents read. Each check needs a pass mark and an owner.
A Shopify go live checklist is the set of checks run on launch day, before and after the store opens to customers. Its customer-side checks should run again through the first 30 days, because problems often appear in the weeks after launch.
Settings, payments, shipping, taxes, notifications, the sending domain, redirects and apps, then a test order and a sign up from a new address. Customers can’t place live orders while payment providers are in test mode, so turn test mode off before launch.
Run a short customer-side check after every release: sign up from a new address, sign in, apply a live code and leave a basket, then confirm each email and text arrives inside its pass mark. A test suite and screenshot diffs cover the code and the layout.
The parts a customer meets after launch: returning customers’ sign in, because passwords can’t be migrated by CSV, old URLs without redirects, email flows rebuilt for the new store, the sending domain, tracking and discount logic. Check each from a new customer’s side on launch day and through the first 30 days.
It designs, builds and migrates stores on Shopify Plus, often after a paid discovery and for a fixed price, then supports them on a monthly retainer. Ringly’s 2026 guide puts a standard Plus retainer at $10,000 to $15,000 a month.
Sources
In the order the article cites them. Every link was checked on 24 Oct 2026.
- Shopify Plus Agency for Development & AI Search
- Shopify Plus partner agency: how to vet, hire, and budget for one in 2026
- Shopify Agency Pricing 2026: Project Costs & Retainer Models
- Shopify Plus Support & Maintenance Services
- What Every Shopify Support Retainer Should Cover (And What Plus Merchants Specifically Need)
- Ecommerce Migration Checklist: Your First Year After a Replatform
- Importing and exporting customer lists
- Customer accounts
- Email marketing benchmarks by Industry 2026
- Setting up your email
- Shopify agencies in Singapore/SEA: how do you test stores after releases?
- Shopify Plus Checkout Tracking Is Broken: Here’s What Happened and How to Fix It
- Placing a test order
- Software Developers, Quality Assurance Analysts, and Testers: Occupational Outlook Handbook
- Recovering abandoned checkouts
- Creating and managing URL redirects
- Shopify Scripts will be deprecated on June 30, 2026
- checkout.liquid
- Non-Plus - Upgrading and replacing your Thank you and Order status pages
- Legacy customer accounts are now deprecated
- Shopify agentic storefronts
- Adobe: U.S. Holiday Shopping Season to Hit Record $275.1 Billion Online, Rising 6.7% YoY
- microsoft/playwright
- Pricing
- Simple, predictable pricing
- Checkout Doctor: Store Alerts
- Pricing