How to test your Shopify store as a customer: the test order, the checks, and AI customers that keep checking

To test your Shopify store, place a free test order with test card numbers in Shopify’s test mode, then shop the store on a phone as a new customer. Check each step against a pass mark, from the buttons and codes to the welcome and reminder emails over the next 48 hours. To check the sign-up, basket and checkout every week and after every change, use Obsession: its AI customers shop your store and your rivals’ as real customers and keep every email, code and page.

Shopify founders and operators can run this test before a launch, after a theme or app change, or when sales look wrong. So can the freelancers and agencies they ask for help. It takes one evening: a free test order, then 10 checks on a phone in the order a shopper meets them, each with its pass mark.

Why test your store as a customer

Shopify’s reports count sessions, carts and checkouts. They leave out what the shopper read on the way: a free shipping banner the cart ignored, a code refused at checkout, a reminder that never came. In the reports, each of those is a checkout that wasn’t finished. Shopify’s help centre asks for at least one test order during store setup and whenever payment settings change.

Paste the ad’s link into the phone’s browser rather than tapping the live ad, which can be billed as a click.

Before you start

• A private window, signed out of the Shopify admin and any customer account, so the store treats the visit as a first one.
• Three new email addresses the store has never seen, one each for the sign-up, the basket and the checkout, so one reminder can’t hide another. Shopify suggests addresses ending in @example.com for test orders where you don’t need to read the email, and fewer than 100 test orders at a time to your own inbox.
• Your phone, plus a phone with the other operating system if possible. Apple Pay and Google Pay buttons depend on the device.
• Your main market first, with a real delivery address, then each other country you sell to. Shipping and tax change with the address.
• Screenshots with the time showing, and one line per check for pass or fail.

How to view your Shopify store as a customer

Open the store’s web address in the private window. That is what a new customer gets today. From the admin, Shopify’s store preview shows “your store as it would be displayed to a customer”: under Sales channels, hover over Online Store and click the eye icon. The private window is still the truer first visit, because the preview is seen signed in as an admin.

To check a draft theme before it goes live, go to Online Store, open the actions menu beside the theme and click Preview. The preview bar can switch the store to another country or language. A shared visitor preview works for anyone for 2 days. The merchant preview reaches checkout for 30 days and needs an admin sign-in.

How to place a test order on Shopify

A test order runs a whole purchase through the store’s real checkout without charging a card. It checks payment, tax, shipping and the order email at once. Shopify names 2 main ways to place one: a payment provider in test mode, either Shopify Payments or the Test payment gateway, and a real order you cancel and refund. Testing a payment gateway needs a paid plan, and a test purchase must come to more than the equivalent of $1.

Shopify Payments test mode

Test mode is a Shopify Payments setting that makes checkout accept test card numbers instead of real cards. Once Shopify Payments is set up, Shopify’s steps are these:

1. From the Shopify admin, go to Settings, then Payments.
2. In the Shopify Payments section, click Manage.
3. In the Test mode section, select Enable test mode.
4. Click Save.

At checkout, use the Visa test number 4242424242424242, any future expiry date, any 3 digit security code and a name of at least 2 words. The number 4000000000000002 shows the message for a declined card. To test Shop Pay, add a test card there with test_card at the start of its nickname. Subscription products need test mode, because the Test payment gateway doesn’t support them.

Shopify’s Test payment gateway (the Bogus Gateway)

The Test payment gateway is a pretend card provider that any store can switch on, with or without Shopify Payments. Many older guides call it the Bogus Gateway. While it is on, every order is a test order. Shopify’s steps are these:

1. From the Shopify admin, go to Settings, then Payments.
2. Switch off the current card provider. For Shopify Payments, click Manage, then Manage payment methods, then Switch to a third-party provider, and confirm. For another provider, click Manage, then Deactivate.
3. Open the list of providers with See all other providers, or Choose a provider where Shopify Payments isn’t offered.
4. Select Test payment gateway, activate it and click Save.

At checkout, enter Test payment gateway as the name on the card. Enter 1 as the card number for an approved payment, 2 for a declined one or 3 for a gateway failure. Any 3 digit security code and any future expiry date work. The gateway doesn’t support subscriptions or Shopify POS, Shopify’s in-person till.

A real order, cancelled and refunded

Pay with a real card, then cancel and refund the order straight away. It is the one method that tests the live payment provider, and the one way to test cash on delivery or bank transfer. Shopify warns that some provider fees aren’t refunded.

Place the order, then turn test mode off

1. Build a cart as a customer would, then go to checkout.
2. Pay with the test details for the method that’s on.
3. Open the order in the admin and check the items, discount, shipping, tax and total.
4. Read the order confirmation email in the new inbox.
5. Turn test mode off, or switch the Test payment gateway off and the real provider back on.

While a provider is in test mode, Shopify says customers can’t place live orders with a credit card. In Shopify Payments test mode, Apple Pay and Google Pay may still complete a checkout with no real charge. Turn test mode off as soon as the test is done. On a store already taking orders, Shopify advises that “you shouldn’t activate test mode on a store that’s in production”. There, a real order, cancelled and refunded, tests payment without pausing live card orders. Don’t fulfil a test order, because Shopify charges for any shipping label bought for it.

A pass: the order completes, appears in the admin with the right total, and its confirmation email arrives. Test mode is off again before the next customer arrives. Shopify also suggests repeating the order with a discount code, signed in and signed out, on a phone and a computer, and with a card that fails.

The 10 customer checks, in the order a shopper meets them

The test order proves payment works. The 10 checks cover what the shopper meets around it. The examples come from 26 October 2026, when an AI agent working for Obsession walked the client stores that Shopify agencies and freelance experts chose to show on their own websites.

1. The ad’s link lands on a live product

Paste the link from the ad with the most spend into the phone’s browser. Then try a Google result and a link from the latest email. A pass: each page loads in seconds and shows the ad’s product and price, in stock in the size and colour the ad showed.

2. On a phone, nothing covers Add to cart or Checkout

Add a product and open the cart. Wait a few seconds on each page, because chat buttons and pop ups can load late. A pass: Add to cart and Checkout can be tapped with nothing on top, on an iPhone and an Android phone. In the walk, a help button sat over Check out on a phone.

3. The cart keeps every promise the page made

Note every promise on the way in, from the banner, the pop up and the product page. Find each one in the cart and again at checkout. A pass: free shipping, a free gift or a subscription price on the page is still there at checkout. In the walk, one banner promised free shipping while the cart asked for a minimum spend. A subscription price fell away in the cart, and a promised free gift never appeared.

4. Every code works, and no expired offer still shows

Try every code on the banner, the pop up and the announcement bar, on a full-price item and a sale item. Add the welcome code once it arrives. A pass: checkout accepts each code on the items it covers, and no banner shows a sale that has ended. In the walk, one store still showed a sale banner the day after the sale ended.

5. Shipping, tax and the total hold no surprise

Enter a real address in each country the store sells to, and read the summary before the payment step. A pass: shipping matches the banner and the shipping page, and any tax or duty is shown. Every line is something the shopper chose. In the walk, one store added a protection charge the shopper hadn’t chosen.

6. Every payment option shows, on both phones

Go as far as the payment page on both phones. A pass: every method the store offers appears, wallet buttons included. Shopify notes that PayPal Wallet is hidden in Shopify Payments test mode, so check the list again with test mode off, stopping before payment.

7. The order confirmation email arrives

A pass: the confirmation reaches the new inbox within minutes, with the right items, total and address. Its link to the order’s status page opens. If it never comes, Shopify suggests checking the Order confirmation template under Notifications and reverting a customised one to the default. Check the spam folder too.

8. The sign-up works and the welcome email arrives

Sign up through the pop up with the first new address. A pass: the welcome email arrives within minutes, and its code matches the pop up’s offer and works at checkout. If the store also has a footer form, test it with another address, because each form can feed a different list.

9. Basket and checkout reminders arrive within 48 hours

With the second address, leave a product in the basket. With the third, start a checkout, type the email and leave before paying. Watch both inboxes, spam folders included, for 48 hours. A pass: a reminder for each, with the item, its price and a link back. An email counts as missing once the 48 hours have passed.

In October 2026 Obsession ran a pilot for 4 agencies on the stores they pitch and serve. Between 21 and 24 October 2026, its AI customers signed up, browsed, left a basket and started a checkout at each store. Each of these journeys had its own inbox, watched for 48 hours. Every store in the pilot had at least one gap. Nearly half sent nothing in the 48 hours after a shopper left a checkout with their email typed in. Most first reminders came within 4 hours, the fastest after 30 minutes, and some about 10 hours later.

10. The store’s chat gives the right answer

Ask the chat what a shopper asks before buying, such as how long delivery takes. A pass: the answer matches the delivery and returns pages, and a person takes over when the chat has no answer. How to test a chatbot on your store covers returns, codes and handoffs.

How to test Klaviyo flows as a customer

Klaviyo, the email and text platform many Shopify stores use, sends flows: automated series such as the welcome emails and abandoned cart reminders. Klaviyo’s help page, updated 7 October 2026, describes three tools inside the account:

• Preview & test shows a flow email filled in with a real event and profile, and Send test sends a copy to your inbox.
• Flow trigger preview checks whether example profiles would enter the flow. It doesn’t test splits or filters on single messages.
• Manual mode holds a flow message for review, so the team sees who reaches it before it sends.

All three test the email and its rules inside Klaviyo. The customer test checks that the live trigger fires. Sign up through the real pop up, leave a basket and start a checkout with new addresses, and watch each inbox for 48 hours. A pass: each email arrives within the flow’s delay, with the right item, price and code. When one never comes, why a Klaviyo flow is not sending works through the causes.

When to test your Shopify store

• Before launch, with the test order and all 10 checks.
• On the day of every theme, app or payment change. Shopify asks for a test order whenever payment settings change, and a theme or app update can break a step that passed the day before.
• Every week, with the 10 checks, stopping before payment, because codes expire, products sell out and flows get edited.
• Every day of a sale, from the day the sale email goes out to the last day. Black Friday is 27 November 2026 and Cyber Monday is 30 November. The Black Friday checklist adds 12 tests for that week.

When orders fall while visits hold, start with traffic but no sales, which rules out tracking and the season first. For the data, speed and search, use the Shopify store audit checklist. Agencies that build and launch stores will find Shopify QA testing and the launch checklist in the guide for Plus agencies.

What one test by hand misses

A test by hand covers 1 phone, 1 set of inboxes and 1 moment. A code edited on Wednesday or an app updated on Thursday stays unseen until the next test. It also shows nothing of what rivals send their new customers: the welcome offer, the reminder timing, the Black Friday code.

For a theme change, Shopify offers SimGym, which its App Store listing places in AI Research Preview. It sends AI shoppers, AI agents the listing says are given human-like personas (profiles of a type of shopper), through a store’s theme before it’s published. They browse, view products, add to cart and describe what they found. A theme comparison shows which version they added to cart on more often. SimGym needs a Liquid storefront and Shopify Network Intelligence turned on. Liquid is Shopify’s theme language, and stores built on Hydrogen or another custom front end aren’t supported. Shopify notes results might differ from real customers. Shopify’s pages describe browsing, carts and feedback. They don’t describe sign-ups, emails or codes. The Shopify SimGym review covers what it tests, what it costs and how far to trust it.

AI customers that keep checking

Obsession makes AI customers that sign up to any company and keep every email, offer and price it sends, so you can find your revenue leaks, watch your rivals and prospect with proof. An AI customer is an AI agent that becomes a real customer of a company, with its own inbox, phone number and browser, and keeps what the company sends and shows it as evidence.

On a Shopify store, each journey, such as a sign-up, a basket or a checkout, gets its own AI customer. It opens the page behind your ads from their links, signs up, takes the welcome code to checkout, and leaves a basket or a checkout. Every email, code and page is kept as it arrived, with its time. Your team chooses when to read the results, at 4, 12, 24 or 48 hours, or keeps the AI customers watching for as long as it wants. An email counts as missing once its window closes, 48 hours for most flows. A new AI customer runs every journey each week, and a theme publish or a flow edit reruns the journeys it touches within the hour.

The same AI customers shop rivals’ stores, so your team sees every welcome offer, price and reminder a rival sends its new customers. They cover email, the pages behind ads, prices and offers, journeys from basket to delivery and support, and what AI assistants say about a store. The team behind Obsession has mystery shopped 1,500 ecommerce stores as a new customer since September 2026. Obsession runs these checks at 300, 1,000 or 5,000 brands a month, and it’s built for millions.

A CAPTCHA is the puzzle a site shows to stop automated visitors. Most stores in the pilot put a CAPTCHA or bot check in front of at least one step. Where a store puts a CAPTCHA in front of a step, the report names the step it couldn’t test. Some visits now come from AI agents shopping for a person, and is your website ready for AI agents gives 10 checks for them.

Ways to test your Shopify store, compared

A Shopify store checker can mean Shopify’s own test tools, an app that runs set journeys on a schedule, AI shoppers that try a theme, or AI customers. Obsession makes AI customers, so every other option is described from its provider’s own pages as of 29 October 2026.

If your store needs the sign-up, basket and checkout checked every week and after every change, at your store and your rivals’, with every email, code and page kept as it arrived, use Obsession. Keep placing a test order in test mode before launch and after payment changes, because it tests the payment step itself. SimGym fits a choice between two themes. Shoptest fits an alert within hours when a set checkout path breaks. A store with steady orders and few changes can run the 10 checks by hand each week.

When a test by hand is enough

• One store that rarely changes, with steady orders, where the 10 checks pass by hand each week.
• A store before its first order, where the test order and one evening of checks cover the launch.
• Orders held in Shopify while analytics or the ad platforms show fewer. The fault is tracking, which traffic but no sales covers.
• A choice between two draft themes. SimGym is built for that question.

Start tonight

Place the test order, run the 10 checks and write pass or fail beside each, then turn test mode off. For the same checks every week, at the store and its rivals, start with the free store check.

Questions about testing a Shopify store