---
title: "AI discovery brings trials. Does it bring growth? | growthinterview.org"
description: "Compare retained buyers and returns before you reward the new channel."
url: https://growthinterview.org/skills/agent-discovery/
---

[Practice interviews](https://growthinterview.org/skills/)

# AI discovery brings trials. Does it bring growth?

* Growth strategy
* Consumer channels
* Invented company and data

Compare retained buyers and returns before you reward the new channel.

> [“we can improve our understanding of our media efficiency by considering incremental cost per new user instead of just cost per new user.” (opens the source)](https://www.grammarly.com/blog/engineering/measuring-marketing-effectiveness-in-a-cookie-less-world/)

![](https://growthinterview.org/_astro/grammarly.com.CdYROqN7.png) Arik Motskin, Michael Haugan and Parth Aidasani, Grammarly Data Science · [Grammarly Engineering Blog, Apr 29, 2024](https://www.grammarly.com/blog/engineering/measuring-marketing-effectiveness-in-a-cookie-less-world/)

* [![](https://growthinterview.org/_astro/grammarly.com.CdYROqN7.png) Grammarly](https://www.grammarly.com/blog/engineering/measuring-marketing-effectiveness-in-a-cookie-less-world/ "Arik Motskin, Michael Haugan and Parth Aidasani, Grammarly Engineering Blog")
* [![](https://growthinterview.org/_astro/wise.com.JZ8qC8pU.png) Wise](https://wise.jobs/job/group-product-manager-scalable-growth-in-london-jid-238 "Wise Careers, Wise Careers")

## The question

Fictional consumer brand Vale compares two acquisition cohorts with the same product, prices and observation window. Acquisition costs and customer outcomes differ.

Equal-sized acquisition cohorts

|                              | Paid search | AI shopping assistants |
| ---------------------------- | ----------- | ---------------------- |
| First-time buyers            | 1000        | 1000                   |
| Acquisition spend USD        | 20000       | 15000                  |
| Repeat buyers within 60 days | 300         | 180                    |
| First orders returned        | 50          | 120                    |

Invented data. Same product, price and observation window; margin is not supplied.

The evidence

* Unknown

  Gross margin, return-processing costs and the accuracy of third-party product descriptions have not yet been checked.

“Would you move most of the budget to AI shopping assistants?”

## A strong answer, step by step

Open each step in turn. This is one strong answer, not the only one.

1 Step 1: Compare the right denominator

What would you do here? Open the move you’d make.

* Move budget because first-order acquisition is 25% cheaper.

  **Tempting, but it misses something.** That compares only acquisition spend per first order and ignores weaker repeat buying.

* Compare repeat buyers, returns and contribution.

  **The strong move.** Repeat-buyer conversion is 30% versus 18%, with the same cohort size.

See how a strong candidate says it

> “Paid search costs about USD66.67 per repeat buyer; AI discovery costs about USD83.33. Lower first-order acquisition cost does not win on this measure.”

What a strong candidate could say

**Why it works:** Repeat-buyer conversion is 30% versus 18%, with the same cohort size.

2 Step 2: Inspect why customers return

> “Returns are 5% versus 12%. Sample the reasons and audit the claims AI shopping assistants display.”

What a strong candidate could say

**Why it works:** A channel can recruit the wrong expectations, even when first orders look cheap.

3 Step 3: Check contribution, not only conversion

> “Calculate contribution after acquisition, product margin, refunds and service costs by cohort.”

What a strong candidate could say

**Why it works:** We cannot infer lifetime value from two orders or compare profit without margin.

4 Step 4: Run a bounded channel test

> “Keep a small test allocation. Correct unsupported descriptions and measure a fresh cohort with the same 60-day window.”

What a strong candidate could say

**Why it works:** This preserves learning without scaling a potentially misleading channel.

## The answer, in short

* Decision

  Do not move most of the budget yet. The AI cohort costs more per repeat buyer and has more returns.

* Because

  The apparent acquisition saving disappears on the repeat-buyer measure; profit remains unknown.

* What would change it

  Higher contribution after returns, or a fresh cohort with better retention after correcting claims, could justify more budget.

## Common traps

* Calling the cheapest first order the best channel.
* Ignoring returns.
* Comparing cohorts with different observation windows.

## Check your answer

* Did I use the same cohort denominator?
* Did I compare cost per repeat buyer?
* Did I include returns and margin?
* Did I define the next test?

Socratify AI Sponsored

## Interview prep with an AI coach?

[Practice on Socratify](https://socratify.ai/?prompt=Interview%20me%20using%20this%20fictional%20practice%20case%3A%20Fictional%20consumer%20brand%20Vale%20compares%20two%20equal-sized%20acquisition%20cohorts.%20Each%20channel%20brought%201%2C000%20first-time%20buyers.%20The%20product%20and%20prices%20are%20the%20same%3B%20acquisition%20costs%20differ.%20Would%20you%20move%20most%20of%20the%20budget%20to%20AI%20shopping%20assistants%3F%20Challenge%20my%20assumptions%20and%20ask%20one%20question%20at%20a%20time.%20Do%20not%20give%20the%20worked%20answer%20first.%20If%20I%20describe%20my%20past%20experience%2C%20require%20a%20real%20example%20and%20distinguish%20my%20actions%20from%20team%20results.&source_host=growthinterview.org&source_path=%2Fskills%2Fagent-discovery%2F&utm_source=growthinterview.org&utm_medium=walkthrough&utm_campaign=growth_pilot&utm_content=agent-discovery)

Last reviewed Nov 11, 2026

[The new onboarding shows a 10% lift. Would you ship it? Next interview](https://growthinterview.org/skills/experiment-readout/)
