Bertie
search
auto_awesomeActioninventory_2Consultant review
Action 5 · Task 78 · Group 4

Stress Test Evidence Quality and Strength

Critically evaluate the rigour, sample size, and recency of the evidence linked to each critical decision. The founder subjects the traceability matrix to intense scrutiny to identify confirmation bias, logical leaps, or fragile metrics.

Objective

Conducting a rigorous quality review ensures that decisions are not greenlit based on flawed or superficial validation signals. This protects the venture from scaling premature solutions on the back of false positives.

What's expected from the founder

An evidence quality report detailing confidence scores for each decision link, highlighting gaps in sample size, method, or objectivity. Red flags and low-confidence nodes must be explicitly logged for remediation.

psychologyBertie consultant stress-test

Five questions an expert would ask when reviewing your output

Use these to challenge assumptions, pressure-test your logic, and check the quality of this action's output in the context of the parent task and wider venture development.

  1. 1

    How do you account for potential confirmation bias in the evidence you have rated as high confidence?

  2. 2

    What makes you confident that your sample size is statistically or qualitatively sufficient to back this decision?

  3. 3

    How would this matrix hold up under due diligence by an institutional seed investor?

  4. 4

    Where have you relied on verbal customer intentions rather than actual observable user behaviour?

  5. 5

    If a key piece of supporting evidence was proven invalid tomorrow, which major decision would collapse?