A better rating system – 5 point scales are the standard on yelp, amazon and elsewhere. Interesting to think if there’s a better way to do this. My biggest gripe is they rarely show the distribution – some things are love/hate in nature. I might see a film or read a book that was highly polarized, but had a 3 average.
NYC subway filled with apples - Amazing little video for a good cause. Don’t miss the making of video below ( read the comments for a very funny, and impressive, complaint).
NIH used to use–I kid you not–a 40 point scale for peer review rating of grant application: from 1.0 to 5.0 in increments of 0.1 (with 1.0 the best). Not surprisingly, given the cognitive impossibility of discriminating that many levels of merit, reviewers basically only used 9 levels at the top, from 1.1-1.9, with anything scored worse than 1.9 being considered undifferentiated horrible crap and 1.0 being considered unattainable perfection.
After years of exhorting peer reviewers to “spread your scores” outside this narrow fraction of the full scoring range, NIH spent a fuckton of money on a revamping of the peer review scoring system. One of the major innovations was to adopt a 1-9 scoring system with only whole numbers allowed. BRILLIANT!
It could have been worse I suppose. They could have argued the solution was a 90 point scale :)
And also, kudos for defining a new unit of measure – the fuckton.
SCOTT'S NEW BOOK
A provocative collection of behind-the-scenes tales from the life of a successful public speaker, bestselling business author
Scott Berkun offers a unique insider's take on what public speakers do, how they do it, and how anyone can do it well.
Book Details
Help w/ new edition of Myths of Innovation Scott Berkun says..."Thanks Dan – that’s a good one. I’ve also been thinking of doing something based on this: Stop saying innovation....'
How I make a living: in detail Scott Berkun says..."Thanks Sean. The book (Confessions) detailed much of the above, so it’s not much of a stretch for me to post it here, in more detail. In...'
How I make a living: in detail Scott Berkun says..."Hi J. Mike: Thanks much for the comment. The tradeoff mostly comes down to time. I do see ways to earn more money, but they mostly involve...'
Receive short, near-monthly emails with new essays, most popular posts, and occasional big announcements. Not cheezy - it's good, funny and concise. (privacy policy here)
NIH used to use–I kid you not–a 40 point scale for peer review rating of grant application: from 1.0 to 5.0 in increments of 0.1 (with 1.0 the best). Not surprisingly, given the cognitive impossibility of discriminating that many levels of merit, reviewers basically only used 9 levels at the top, from 1.1-1.9, with anything scored worse than 1.9 being considered undifferentiated horrible crap and 1.0 being considered unattainable perfection.
After years of exhorting peer reviewers to “spread your scores” outside this narrow fraction of the full scoring range, NIH spent a fuckton of money on a revamping of the peer review scoring system. One of the major innovations was to adopt a 1-9 scoring system with only whole numbers allowed. BRILLIANT!