Last night I drifted off to sleep thinking about scientists and online collaboration. I’ve been thinking about these things as I drift off to sleep much more frequently than usual since I read the chapter on “social information foraging” in Peter Pirolli’s Information Foraging Theory. In said chapter, Pirolli describes a number of studies of trends in large groups of specialists working towards a common set of goals, and the degree to which such communities of specialists collectively aid their individual members in making contributions to meeting said goals. The subjects explored within a few of these studies that really caught my eye were the use of co-citation analysis to visualize a field of study or network of specialists, and, as Pirolli puts it, the “brokerage of structural holes” in these networks. The former of these I was familiar with, as the technique’s been pretty well explored from a variety of angles, but I had never seen the latter presented the way in which Pirolli does.
Continue Reading...Archive for May, 2008
Innovative Collaboration
Tuesday, May 27th, 2008Yes, Keyword Search is About to Hit its Breaking Point
Tuesday, May 27th, 2008A debate rippled across a few tech blog sites following Erick Schonfeld’s reiteration, a few weeks ago, of some claims made by Nova Spivack concerning the fate of traditional keyword search. As Schonfeld explains, Spivack is of the opinion that as the number of web pages a search engine has to sift through explodes exponentially, the efficacy of a simple keyword search will drop off. Spivack himself explains the problem as follows:
“Keyword search engines return haystacks, but what we really are looking for are the needles. The problem with keyword search such as Google’s approach is that only highly cited pages make it into the top results. You get a huge pile of results, but the page you want—the ‘needle’ you are looking for—may not be highly cited by other pages and so it does not appear on the first page. This is because keyword search engines don’t understand your question, they just find pages that match the words in your question.”
Continue Reading...