Company deep dives

Duolingo interviews

United States

Experiments

“Make a decision as soon as you're confident you have the data to do so.”

Sean ColomboCo-lead, Duolingo Growth Area

Duolingo Blog · 2023-11-03

Decide as soon as the data allows

Decide whether a 10% onboarding lift is ready to ship.

Example

“it is a huge advantage to do the most efficient, high-ROI projects first, because they will have a longer period of paying compound interest.”

Sean ColomboCo-lead, Duolingo Growth Area

Duolingo Blog · 2023-11-03

High-ROI work first compounds

Decide whether a 10% onboarding lift is ready to ship.

Example

“If the imperfect version is strictly an improvement over the prior experience, launch it to new users (which starts the compound gains) and then make the improvements through iterative experiments after that.”

Sean ColomboCo-lead, Duolingo Growth Area

Duolingo Blog · 2023-11-03

Launch the improvement, then iterate

Decide whether a 10% onboarding lift is ready to ship.

Example

Metrics and funnels

“Then, we figured out which of those steps would be the biggest hurdle and optimize for it.”

Jackson ShuttleworthProduct manager, Duolingo

Duolingo Blog · 2024-09-20

Find the biggest hurdle

Decide whether a jump in plan generation should become the goal.

Example

Retention

“An even more pronounced compound growth effect is seen in retention metrics.”

Sean ColomboCo-lead, Duolingo Growth Area

Duolingo Blog · 2023-11-03

Retention compounds most

Decide whether falling retention means rolling back an AI launch.

Example

“lowering the barriers to building a consistent daily habit is more important to successfully learning a language than how much you learn each day, at least early on”

Anton YuDuolingo Blog author

Duolingo Blog · 2020-11-19

Habit before volume

Decide whether falling retention means rolling back an AI launch.

Example

The work itself

“We run experiments on almost everything we do, and launching these experiments quickly has a meaningful impact on our long-term success.”

Sean ColomboCo-lead, Duolingo Growth Area

Duolingo Blog · 2023-11-03

Experiment on almost everything

Decide whether AI share cards that doubled sharing should roll out.

Example

Last reviewed