Case studies

Understand the business. Understand the customers. Then let AI bridge the gap.

From the counter to the agents: research into how a precious-metals dealer actually runs and who its customers are, then five AI agents that bridge the gap between the two.

Fourteen problems found in the business, five agents built on what the research found.

At a glance

Role
Principal, UX Research Associates. Research, strategy and the build.
Client
A single-location precious-metals and coin dealer in Southern California, unnamed until they agree to be named
Methods
Contextual inquiry and a read-only systems walk, counter observation, competitor scan, three personas, decision gates, five scheduled agents on the OpenAI API
Outcome
A documented operating core, one defensible position, an instrumented funnel, a new sales channel, and five agents that began by reading and flagging, two of which have earned the authority to act and log what they changed

Summary

The owner's question was the one every operating business asks before an AI initiative: where is the money going, and what should we do next? Instead of starting with tools, I started with research. A read-only walk of the point-of-sale system, the business's system of record, surfaced fourteen data problems nobody had seen. Persona work found three kinds of customer at the counter and one position the store could defend for all of them. Only then did the strategy, the instrumented stack and the five agents follow, each gated on the step before it, with the agents earning authority the same way.

What the owner got

An operating manual and a problem list
Process narratives for the POS and a remediation log for fourteen data problems, each with a root cause and an owner. The business had never seen itself written down.
Three counter personas and a position the staff can say out loud
The inheritance seller, the bullion buyer and the cash-for-gold customer, and the one position that holds for all three: "We show you the math." The assay reading is photographed and shown, the written quote is good through close of business, and the payout sheet is posted.
A strategy written as decision gates
One funnel, one owner, strict order, five scorecard numbers, dated go/no-go gates and a decision log, on one board with an automated weekday brief.
An instrumented stack and a new channel
Attribution from call tracking into GA4 and Google Ads, an SEO platform held in review-only mode, visibility monitoring, and graded coins listed on eBay.
Five agents, each with one job, and a way for them to earn authority
Inventory auditor, eBay helper, compliance and holds, premium tracker, financial reconciler. Scheduled by when their data is reliable, tiered by financial exposure, and pausable by the owner. All started by reading and flagging; the premium tracker and the eBay helper have since earned the right to act, logging every change and publishing a summary.

The work

The starting point

The dealer had a strong reputation and plenty of tooling: a vertical point-of-sale system running the whole business, a paid SEO platform, a Yelp ad budget, and a Google Ads account that had been paused for two years. Almost none of it was connected, measured or reviewed. Answering the owner's question meant treating the work as an operational transformation with AI at the end of it.

Understand the business: research before anything else

I started in operations, not marketing. The POS was the system of record for cash, inventory and customers, so its reliability set the ceiling on everything downstream.

The method was contextual inquiry applied to a system: a read-only walk of every module, then controlled create-verify-delete tests of each workflow that touches cash or inventory. I documented each test as it ran, which turned the assessment into the business's first operating manual for a system that had none.

The assessment surfaced fourteen data problems nobody had seen, including phantom receivables, months of uncashed checks, two cash balances that disagreed with each other, inventory carried at the wrong cost, and stale open orders. Each was logged with a root cause, an owner and a remediation path. Several became the specification for the agents.

Understand the customers: three personas, one position to defend

The same research discipline, pointed at the other side of the counter. Observation at the counter, conversations with staff and a competitor scan produced three personas: the inheritance seller, the bullion buyer and the cash-for-gold customer. They arrive with different questions and different stakes, and the business had been treating them as one.

What held for all three was one position the store could defend: "We show you the math." Every later decision, from the Yelp plan to the ads keywords to what the agents watch, traces back to those three personas, that position and the problem list.

Strategy with gates, not a wish list

The strategy was a sequence, each step gated on the one before it:

  1. A 30-day Yelp plan, measured at day 30.
  2. Google Business Profile and the SEO platform, run as a 20-minute weekly routine.
  3. A conservative Google Ads relaunch on sell-side keywords only, with a go/no-go decision.
  4. The online store, launched in waves.

Five scorecard numbers, dated go/no-go gates through December, and a decision log. Decisions were written down as they were made: no Saturday hours yet, no asking for reviews, and nothing deployed to the live site without a person approving the batch. The plan lives on one board with an automated weekday brief, so the owner can see execution without a status meeting.

The stack, wired together with no code access

The POS vendor renders the website, and there is no code access. The work was finding the levers that did exist: a real CMS behind the storefront, a tag-manager slot, and the allow-list that governs every third-party script. With those three, in one week:

  • On-page and technical SEO. Brand-voice titles and descriptions on the top pages, stale sitemaps replaced, canonical-URL and tracking errors fixed.
  • Attribution. Call tracking with a website number pool and a dedicated Yelp number, both feeding GA4 and Google Ads.
  • Governed automation. The SEO platform's on-page engine installed but held in review-only mode. It proposes; a person approves the batch.
  • Visibility monitoring. Local rank tracking, a monthly Google Maps local-ranking heatmap, and AI-search visibility monitoring against hand-written local queries.
  • A new channel. A marketplace connector live with graded coins listed on eBay, business policies set, and the connector's category bug diagnosed and worked around.

The principle throughout: instrument first, then automate, and never let a tool write to the live site or the live ad account unsupervised.

Let AI bridge the gap: agents on the controls, with authority earned at gates

With the data flowing, the last step was to stop depending on someone remembering to check. Five scoped agents built on the OpenAI API, each with one job, a schedule set by when its data is reliable, and a risk tier for what it flags. The agent with the most to get wrong was deployed last.

AgentWhenReadsFlagsAuthority
Inventory auditorEvery morningPOS, marketplace connector, eBayCert mismatches, price drift from the numismatic price guide, bullion outside the premium band, items sold online still in stock. Double-sale risk is the critical tier.Reads and flags
eBay helperTwice dailyMessages, offers, orders, listingsBuyer messages, offers, the one-business-day handling promise, returns, mis-categorized listings, sync errorsActs and logs: rewrites listing descriptions and fixes categorizations. Began as drafts for approval.
Compliance and holdsEvery morningPOS transactions, customer recordsMissing ID, unfiled state reports, hold periods expiring or violatedReads and flags
Premium trackerOpen and closeSpot price, a local competitor-pricing dataset it buildsReprice alerts on spot or competitor movesActs and logs: changes prices. Began as read and flag.
Financial reconcilerWeeklyOrders, marketplace payouts, POS sales, bank data as a dropped-in fileOrders, payouts and POS sales that don't agreeReads and flags

At the start, every agent read and flagged. None moved money, published or sent. A person approved every outbound action, escalation thresholds were tiered by financial exposure, and the owner could pause any agent by turning off its schedule. The reconciler has no bank login and ran last because it earns trust last.

That was the starting authority, not the end state. Authority is earned at gates: an agent moves up a level once its flags have been right for long enough and the owner has seen what it would have done. Two have moved so far. The premium tracker now changes prices itself when competitors move, inside a guardrail set around the spot price: nothing sells below spot and nothing buys above it. The eBay helper, which began by drafting replies for approval, now rewrites listing descriptions and fixes categorizations on its own. Every agent that acts logs what it changed and why, and publishes a summary the owner reads instead of approving each change. The gates for the next level, and the governance that goes with them, are the current work.

Agent authority, five agents across three levels Every agent began at the first level, reads and flags. The eBay helper has moved to the third level, acts and logs, after a period of drafting for approval. The premium tracker has moved from reads and flags straight to acts and logs. The inventory auditor, compliance and holds, and the financial reconciler remain at reads and flags. Reads and flags Drafts for approval Acts and logs Inventory auditor eBay helper Compliance and holds Premium tracker Financial reconciler current authority earned at a gate not yet
Where each agent stands today.

For a cash-and-metal business, the first job of automation is to leave the books more reconciled than it found them.

Success is judged at the gates. The Yelp plan is measured at day 30, the Google Ads relaunch has a go/no-go decision, the local-ranking heatmap is read monthly, and each is reported against the five scorecard numbers.

What carries over

  1. Research the system of record first. The data-integrity assessment is the specification for the agents.
  2. Write the strategy as decision gates. Dated go/no-go gates, a few numbers and a decision log make progress visible and reversible.
  3. Instrument first, then automate. Measurement and attribution come before any tool is allowed to act.
  4. Start agents with no authority, and let them earn it. Read and flag first, with a person approving every outbound action and deployment order set by trust. Then gates that grant the right to act, with every change logged and summarized.
  5. Measure outcomes, not activity. Report against the scorecard at the gates, not the number of things shipped.