As you have probably noticed, yesterday’s BioBarCamp was covered in depth over at FriendFeed and additionally Cameron was streaming video live from the event (it’s still available under the same address). One particular session drawed my attention, because it was about measuring impact of scientists. It’s something I have very strong opinion about since couple of weeks, so forgive me this rant.
Peter Binfield (PLoS) and Pedro Beltrao did a great job on presenting current status of the issue and presented potential way to measure impact of a publication (quoting after Shirley – “your article received x citations, viewed x times, received x comments, bookmarked x times, rated x by experts, discussed on x respected blogs, appeared in x news media, etc etc” – instead of single “your article was published in journal with IF of X”). And while two months ago I was really interested in such discussions and willing to help, today I simply don’t care. The reason is simple and is presented in the post title: by any measure, I’m average at most.
That’s absolutely obvious that majority of scientists is at most average by any standard or measure. And that is not going to change, at least not much. Those who are at the top by Impact Factor today, will be at the top by other measure. Those who do some not-that-important stuff like me, will be still pretty average by other measure. One of the reasons may be all kinds of issues with normalization of the field size (there’s too much problems with biological ontologies to believe that dividing science space into fields is going to work much better). Another thing may be relative importance of the field (that’s something different from field size) – human research will always draw more attention than electrochemistry. And I could go on and on – all these issues aren’t novel and have been described and discussed in thousands of blog posts. The point is that even if such new ideal measure is going to be fair, it will not change life of majority of scientists. Not only because some of us do average things, but also because some of us have average money (BTW, I haven’t found much discussion on including in the measure research budget, which surprises me given the fact that amount of money spent on a project correlates pretty much with the IF of the journal it is published in afterwards).
So, I don’t really care if IF stays or not (although people working on improving measuring get my deep respect). Reputation-wise I’m going to be in the middle unless I will make something extraordinary. But honestly to make a scientific breakthrough the last thing I need is a number describing quality of my thinking.