Essay

Measuring progress without vanity metrics

9 min read · Instrumentation

Person analyzing charts on a laptop

A goal dashboard can look sophisticated and still answer the wrong question. Session length after opening the goal tab, badge unlock counts, and “motivation score” composites often rise while users report feeling managed rather than helped.

Start from the sentence users should finish

Before instrumentation, write the user sentence: “I know I am on track because ___.” If your events cannot complete that sentence, you are decorating, not measuring. Online Framehub workshops keep that sentence on a sticky note through the entire critique.

Prefer irreversible progress signals

Events that cannot be gamed by idle tapping — confirmed transfers, submitted practice clips, completed checklists with item-level truth — beat hover-rich heatmaps. Pair them with a recovery event so missed days do not disappear from analysis.

Stakeholder translation

Executives may still want a north-star number. Give them one, then show the two leading signals that explain it. When Goal Tracking for Mobile Products is healthy, those leading signals move first; when only the north star moves, investigate gaming or seasonal noise.

For a deeper instrumentation module, see Mobile Goal Systems Intensive.