Calibrating ICP weights.

Five components. The right weights are the ones your reviewers do not argue with.

The five ICP components are industry fit, size fit, stack fit, motion fit, and intent fit. The default weights in every pack are even, 20 each. Do not leave them there.

How to calibrate

Take twenty leads that scored above your threshold and that your reviewers approved. Take twenty that scored above your threshold and that your reviewers rejected. Look at the per-component breakdowns. The components where the two groups separate the most are the ones that should weight higher.

A worked example

A devtools customer came in at the default 20/20/20/20/20. Their reviewers were rejecting half the passes, which means the threshold was meaningless. We pulled the breakdowns. The approved set scored a median 78 on stack fit; the rejected set scored 41. The other components were roughly tied. We moved stack fit to 35 and reduced the others. Reject rate at qualify dropped from 49% to 18% within a week.

A warning

Do not weight to your wishes. Weight to your reviewers' decisions. The data is in the rejections.