Product workflows2026-10-282 min read

Audit an Amplitude Metric Before a Decision

Before acting on a metric, verify that it measures the intended outcome for the intended population and period. This is a manual analysis checklist, not a native certification that a chart is decision-ready.

Before you start: Have the saved chart, underlying definitions and one known user journey. Identify the decision and the harm of drawing a wrong conclusion.

Worked example: A reported activation drop could reflect a release, a missing event property or an incomplete cohort. The checklist should establish trust before the team prioritizes an onboarding redesign.

Step-by-step guide

01

State the decision

Write what action the metric could change. Define the outcome and counting unit before reviewing the visualization.

02

Verify event meaning

Check the trigger, success condition and recent instrumentation changes. Compare a known journey with the report.

03

Inspect identity and population

Review eligibility, internal-user exclusions and the relevant identity contract. Confirm the denominator reflects real opportunity.

04

Check time and maturity

Align date ranges, time windows and cohort age. Identify incomplete data or periods with different capture coverage.

05

Reproduce the result

Open the saved analysis and verify filters and segmentation. Record enough query context for a colleague to repeat the check.

06

Write a qualified conclusion

Separate the observation from the explanation. Record uncertainty, a next investigation and the owner of any data-quality fix.

Common mistakes

Chart title trusted alone

A label can conceal a different query.

Time windows ignored

Unequal observation can create false deterioration.

Association becomes cause

A valid metric still does not prove the proposed explanation.

Tips

Keep a known journey as a sanity check.

Record capture changes before discussing product impact.

Ask a second person to reproduce the query.

Sources and verification

Based on product documentation checked on 2026-10-24. This is a documentation-based guide, not a hands-on benchmark. Features and availability can change.

Frequently asked questions

Spend less time on setup, more on decisions

Vantage connects your tools and generates specs grounded in real data. Free to start.

Experiment brief

Measuring a change in Amplitude? Write the experiment brief before you ship.

Describe the change and the number you want to move. Vantage turns it into a written brief you can share with eng and data before anything ships.

0 / 8,000

How this works

  1. We save what you typed. No AI runs on this page.
  2. You create a free account.
  3. Vantage builds an experiment brief from it inside your own workspace.

Why ask for an account? We’re a small team, and a full generation runs a multi-step AI pipeline that costs us real money. So we tie it to a free account instead of running it anonymously. You also get to keep the result and edit it.

Your text is only used to create your project, and it stays private to your account. If you don’t sign up, we delete it after 7 days. Privacy policy

Free to start. No credit card required.

Related reading