• Print
  • December 16th, 2009
  • 2 Comments »
  • linkfest

Wednesday linkfest

Here are this week’s links:


Leave a Comment / What do you think?

Your email is never published nor shared (comments policy).

2 Responses

  • Mike Nitabach - December 19, 2009 at 3:30 pm #
  • NIH used to use–I kid you not–a 40 point scale for peer review rating of grant application: from 1.0 to 5.0 in increments of 0.1 (with 1.0 the best). Not surprisingly, given the cognitive impossibility of discriminating that many levels of merit, reviewers basically only used 9 levels at the top, from 1.1-1.9, with anything scored worse than 1.9 being considered undifferentiated horrible crap and 1.0 being considered unattainable perfection.

    After years of exhorting peer reviewers to “spread your scores” outside this narrow fraction of the full scoring range, NIH spent a fuckton of money on a revamping of the peer review scoring system. One of the major innovations was to adopt a 1-9 scoring system with only whole numbers allowed. BRILLIANT!


  • Scott Berkun - December 19, 2009 at 7:25 pm #
  • Mike: Great story. Thanks for sharing.

    It could have been worse I suppose. They could have argued the solution was a 90 point scale :)

    And also, kudos for defining a new unit of measure – the fuckton.


Scott's Bestselling Books
  • Confessions of a
    Public Speaker
  • Provocative and funny secrets from a veteran speaker, you'll laugh as you learn.
  • Buy now at Amazon Book Details
  • The Myths of Innovation
  • The classic bestseller on how amazing lessons from the past can help you innovate today.
  • Buy now at Amazon Book Details
  • Making Things Happen
  • The classic and bestselling handbook for any project leader, packed with tactics and stories.
  • Buy now at Amazon Book Details
Photos from Recent Events (view flickr stream)

You're reading Scott Berkun, All rights reserved unless noted. You can subscribe here Blog RSS Comments (RSS)