Agency evaluation · Lesson 3 of 5 · 25 minutes
Plan one screenshot test. Make the question worth answering.

Look at your first screenshot and write the claim it makes to a stranger. Then identify the question you need answered. For example: would showing the recording workflow make the app’s purpose clearer than opening with an award? That is a more useful starting point than a colour preference looking for a research budget.
Prepare a variant around that question and keep unrelated changes stable where practical. Record the message, audience and reason for the change. Producing an asset takes work even when your store account provides the experiment interface. Compare the agency’s research, creative and operating responsibilities before calling the entire test “free”.
Use the screenshot testing guide and current platform documentation to check eligibility and setup in App Store Connect or Play Console. Name the publishing owner, metric, review conditions and operational checks. The tools on this site help prepare the brief; they do not publish a store experiment for you.
Allow an inconclusive result. Traffic, effect size and audience differences affect what you can learn. Do not turn a calendar deadline into a statistical conclusion. A useful team can explain why it would run, postpone or stop an experiment without inventing a winner to keep the meeting cheerful.
Today’s task
- Write the claim, alternative message and hypothesis.
- Use the test planner to record audience, metric and review conditions.
- Check platform eligibility and production responsibilities before deciding whether to launch.
Related: Read the screenshot testing guide · Prepare an experiment brief · Get screenshot and conversion support · Why I am not an ASO agency
Get the rest by email
One a
week.
Then silence.
Five lessons over five weeks, then nothing. If you tell me which agency you are paying, day two arrives tailored to them.