leadership strategydiscoverynorth star metricsproduct managementroadmap
Complete evaluation framework
What to assess and how to score it
Review the evidence signals before interviewing. Then use the anchored descriptions—not instinct alone—to choose the score that best matches each answer.
01
Evaluation factor
Record of outcomes
35% weight
Ask which shipped features they owned end to end, the adoption or retention numbers moved, and how they killed or sunset work that underperformed.
Evidence to listen for
Names organisations, budgets, and headcount they were actually accountable for
Gives outcomes with numbers, not initiatives with adjectives
Separates what they drove from what the market or a predecessor did
Can describe something they owned that failed
Five-point scoring guide
1
Poor
Titles and initiatives only; no accountable outcomes.
2
Needs Improvement
Claims results the organisation would have had anyway; no scope clarity.
3
Satisfactory
Real accountability with some numbers; attribution occasionally generous.
4
Very Good
Clear scope and measured outcomes, including an honest failure.
5
Excellent
Names specific releases with before and after metrics (activation, churn, ARPU) and admits which bets they cut and why.
02
Evaluation factor
Strategic judgement
25% weight
Probe how they chose between roadmap options: pricing changes, build versus buy, platform investment, and what evidence from discovery interviews or usage data decided it.
Evidence to listen for
Explains a decision where the options were genuinely close and the information incomplete
Can say what they chose not to do and why
Distinguishes a bet from a certainty
Changes course on evidence rather than defending a position past its life
Five-point scoring guide
1
Poor
Frameworks and slogans; no real decision they can walk through.
2
Needs Improvement
Describes decisions made elsewhere; cannot state the trade-off.
3
Satisfactory
Sound judgement on familiar decisions; less tested on ambiguous ones.
4
Very Good
Walks a genuinely close call, states what they gave up, and changed course on evidence.
5
Excellent
Frames trade-offs against a clear thesis, cites discovery data and cohort analysis, and explains what they deliberately did not build.
03
Evaluation factor
Building and leading teams
25% weight
Assess how they run a squad without formal authority: rituals with engineering and design, backlog grooming, and mentoring associate or junior PMs.
Evidence to listen for
Has hired, developed, and where necessary removed people
Names someone who grew under them and what they did to cause it
Handles an underperformer directly rather than waiting it out
Builds a team that functions when they are not in the room
Five-point scoring guide
1
Poor
No real people leadership; avoids difficult personnel decisions.
2
Needs Improvement
Managed a team but cannot describe developing or exiting anyone.
3
Satisfactory
Competent manager; development is informal.
4
Very Good
Demonstrable record of growing people and handling underperformance directly.
5
Excellent
Describes concrete working agreements with eng leads and designers, and shows a junior PM they coached into owning a surface area.
04
Evaluation factor
Influence across the business
15% weight
Look for how they aligned sales, support, and legal on a contentious launch: pricing sign-off, migration comms, enablement decks, executive review cadence.
Evidence to listen for
Wins support from peers and boards without positional authority
Translates their function into terms the rest of the business cares about
Delivers unwelcome news early
Manages up without either capitulating or stonewalling
Five-point scoring guide
1
Poor
Relies entirely on authority; conceals bad news.
2
Needs Improvement
Struggles to influence peers; communicates in function-specific jargon.
3
Satisfactory
Works adequately with peers and leadership.
4
Very Good
Persuades peers and boards on merit and delivers bad news early.
5
Excellent
Recounts a launch where they won over a resistant stakeholder group with data, and names the forum and artefact used.
Put this rubric to work
Score every candidate against the same standard
Add these weighted factors to Hirevire and let AI evaluate recorded answers against your rubric.
