Audit an Amplitude Metric Before a Decision
Before acting on a metric, verify that it measures the intended outcome for the intended population and period. This is a manual analysis checklist, not a native certification that a chart is decision-ready.
Before you start: Have the saved chart, underlying definitions and one known user journey. Identify the decision and the harm of drawing a wrong conclusion.
Worked example: A reported activation drop could reflect a release, a missing event property or an incomplete cohort. The checklist should establish trust before the team prioritizes an onboarding redesign.
Step-by-step guide
State the decision
Write what action the metric could change. Define the outcome and counting unit before reviewing the visualization.
Verify event meaning
Check the trigger, success condition and recent instrumentation changes. Compare a known journey with the report.
Inspect identity and population
Review eligibility, internal-user exclusions and the relevant identity contract. Confirm the denominator reflects real opportunity.
Check time and maturity
Align date ranges, time windows and cohort age. Identify incomplete data or periods with different capture coverage.
Reproduce the result
Open the saved analysis and verify filters and segmentation. Record enough query context for a colleague to repeat the check.
Write a qualified conclusion
Separate the observation from the explanation. Record uncertainty, a next investigation and the owner of any data-quality fix.
Common mistakes
Chart title trusted alone
A label can conceal a different query.
Time windows ignored
Unequal observation can create false deterioration.
Association becomes cause
A valid metric still does not prove the proposed explanation.
Tips
Keep a known journey as a sanity check.
Record capture changes before discussing product impact.
Ask a second person to reproduce the query.
Sources and verification
Based on product documentation checked on 2026-10-24. This is a documentation-based guide, not a hands-on benchmark. Features and availability can change.