Thursday, June 12, 2008
Saturday, November 10, 2007
Bibliometrics and research quality measurement
Anyone who is involved with impact factor, peer review, citation searching etc should peruse this report from Universities UK. Here is Guardian's brief on this.
Here are some highlighted points from the report:
- "Bibliometrics are probably the most useful of a number of variables that could feasibly be used to measure research performance.
- There is evidence that bibliometric indices do correlate with other, quasi-independent measures of research quality - such as RAE grades - across a range of fields in science and engineering.
- There is a range of bibliometric variables as possible quality indicators. There are strong arguments against the use of (i) output volume (ii) citation volume (iii) journal impact and (iv) frequency of uncited papers.
- 'Citations per paper' is a widely accepted index in international evaluation. Highly-cited papers are recognised as identifying exceptional research activity.
- Accuracy and appropriateness of citation counts are a critical factor.
- There are differences in citation behaviour among STEM and non-STEM as well as different subject disciplines.
- Metrics do not take into account contextual information about individuals, which may be relevant. They also do not always take into account research from across a number of disciplines.
- The definition of the broad subject groups and the assignment of staff and activity to them will need careful consideration.
- Bibliometric indicators will need to be linked to other metrics on research funding and on research postgraduate training.
- There are potential behavioural effects of using bibliometrics which may not be picked up for some years
- There are data limitations where researchers' outputs are not comprehensively catalogued in bibliometrics databases." via Universities UK
Posted by
Rafael Sidi
at
3:17 PM
2
comments
Labels: bibliometric, ciations, eigen factor, Elsevier, h-index, impact factor, ISI, ISI eigen factor impact factor scopus, scopus, Thomson
Wednesday, November 07, 2007
Wild ducks needed for innovation
In a Newsweek interview Intel's former CEO Andy Grove calls for a "cultural revolution in research community" and hits on pharma industry's inefficiency and peer review system.
"The peer review system in grant making and in academic advancement has the major disadvantage of creating conformity of thoughts and values. It's a modern equivalent of a Middle Ages guild, where you have to sing a particular way to get grants, promotions and tenure. The pressure to conform [to prevailing ideas of what causes diseases and how best to find treatments for them] means you lose the people who want to get up and go in a different direction. There is no place for the wild ducks. The result is more sameness and less innovation. What we need is a cultural revolution in the research community, academic and non-academic. We need to give wild ducks the opportunity to emerge and quack their way to success. But cultural change can be driven only by action at the top." via NewsweekThis comment from Andy Grove reminded me of The Matthew Effect which Nassim Nicholas Taleb highlights in Black Swan:

"Academic success is partly (but significantly) a lottery.Now, that brings a completely different perspective to the whole citations searches and impact factor business.....
Posted by
Rafael Sidi
at
12:15 AM
0
comments
Labels: Elsevier, ISI, ISI eigen factor impact factor scopus, research, research workflow, Thomson
Wednesday, October 24, 2007
New face of e-training: Elsevier Training Desk
Nop, our new TrainingDesk is not your father's Oldmobiles.
The new TrainingDesk includes a blog by Gali Halevi, a wiki where customers can collaborate and share their training experiences; and plenty of tutorials and presentations about Embase, Scopus, Science Direct and Engineering Village. I think this is a great attempt to make training more interactive and get customers input and contributions. I can see the wiki turning into a great collection of training materials including videos which are created by our academic and corporate librarians, and students. It's refreshing to see that our customers can access to all these products' training materials in one location. Also we are taking the training to a new level i.e from teaching boolean search to topic-focused online seminars. Now let's see how our customers will use the site. 
Posted by
Rafael Sidi
at
9:23 PM
3
comments
Labels: e-learning, e-training, Elsevier, Engineering Village, ISI eigen factor impact factor scopus, science direct, training
Sunday, May 13, 2007
After the impact factor now comes the Eigenfactor
Eigenfactor which is developped by the Bergstrom lab is a new method of evaluating the influence of scholarly journals. "The Eigenfactor score of a journal is an estimate of the percentage of time that library users spend with that journal." via Loomware
Here are some statistics comparing ISI's impact factor and article influence.
Posted by
Rafael Sidi
at
10:54 PM
0
comments