Zero Sum
How wonderful that we have met with a paradox. Now we have some hope of making progress. — Neils Bohr
Click on the section headings below to reveal/hide the contents
Substance: WordPress Style: Rachel
Posted Jul 25th, 2011 by ravi    / Permalink /

David DeGusta and Jason Lewis, writing in the New Scientist, raise the question “Is bias inevitable in science?“, and answer:

Stephen Jay Gould claimed unconscious bias could affect even seemingly objective scientific measurements. Not so.

Why not? Because “[scientific] method is so robust” that it can overcome the bias of scientists. Scientific Method has been studied greatly in the fields of History and Philosophy of Science – and cautiously defined and defended, criticised, found wanting or polemically dismissed – but DeGusta and Lewis are, in their piece, not concerned with these arguments, but rather with the particular story of “Gould’s skulls” and what that story tells us about scientific bias.

The backstory in short: In his analysis of the cranial measurements conducted by a 19th century scientist named Samuel Morton, Gould found that Morton had “manipulated his samples, made analytical errors” and mismeasurements. Gould concluded that these errors were a result of Morton’s racist bias.

DeGusta and Lewis go on to update the story with details of the recent effort by Lewis and collaborators to remeasure the crania studied by Morton and their finding that if anything, Morton overmeasured Egyptian crania (not white ones).

And therefore they write, in a passage that arguably summarises their thesis:

Gould was certainly right that all scientists, as humans, have some sort of bias. But while biased scientists are inevitable, biased results are not, as illustrated by Morton (biased) and his data (unbiased, as far as we can tell). Science does not depend on unbiased investigators but on methods which limit the ability of the investigator’s bias to influence the results.

Which raises the question of what method it is that permits the authors to generalise from a single [empirical] finding (the case of Morton’s lack of measurement error despite  the harm to his racist beliefs) to so general a claim as “biased scientists are inevitable, biased results are not” and their answer “Not so” to their own question “Is bias inevitable in science?” (it is worth noting that the title does not restrict itself to scientific measurements).

After all Gould does not claim that all results are inevitably biased. The authors do not provide any direct quotes from Gould in lieu of which I repeat the authors’ summary of Gould’s view: “Stephen Jay Gould claimed unconscious bias could affect even seemingly objective scientific measurements” [emphasis mine]; even they do not suggest that “Stephen Jay Gould claimed unconscious bias affects all objective scientific measurements“.

This is not, I believe, a trivial matter. The authors claim in a self-congratulatory tone that they (one of them) did the obvious thing that Gould had failed to do – to wit, remeasure the skulls. At the same time, they also claim that Gould’s thesis pertains primarily to “objective scientific measurements” or “actual measurements” [emphasis mine]. But if Gould did not actually remeasure the skulls, on what did he base his argument that the measurements were wrong? For this we can look to Gould’s original article:

Morton published all his raw data, and it is shown here that his summary tables are based on a patchwork of apparently unconscious finagling. When his data are properly reinterpreted, all races have approximately equal capacities.

It is worth quoting multiple sections from Gould’s original article to make the point to follow. Gould writes:

Morton … did supply one rare and precious gift to later analysts: he published all his primary data… I have reanalyzed Morton’s data and I find that they are a patchwork of assumption and finagling[.]


[…] Morton’s method is suspect from the start for two reasons. First, he did not distinguish male from female skulls…. Second, he measured capacity by filling the skull with white mustard seed, sieved to reduce variation in grain size.

[Note: I am intentionally leaving out the substantive bits of Gould’s argument in defence of his claim, since they do not pertain to the analysis here of DeGusta and Lewis’s critique.]

What becomes clear in reading Gould’s paper is that contrary to DeGusta and Lewis’s summary, Gould was concerned with the measurement methodology and statistical presentation used by Morton. Having placed a thesis in their opponent’s mind that bias impacts “actual measurements“, DeGusta and Lewis are surprised that Gould did not then regenerate the “actual measurements“. But Gould was content to work with the “primary data” published by Morton – Morton’s “precious gift“. Contrary to DeGusta and Lewis’s apparent understanding, it should be clear from the quoted sections above that Gould’s claim is not that bias miraculously jumps from the scientist’s mind into the measuring devices and thence to the raw data.

Time and again, Gould in his paper mentions the problem of “finagling” (dictionary: “act in a devious or dishonest matter”) and it’s centrality. An issue dismissed to the margins by DeGusta and Lewis: “extreme bias cannot, short of fraud, influence the results” [emphasis mine]. By mentioning and dismissing the conscious act of fraud, DeGusta and Lewis ineffectively dismiss the “large middle ground” (to borrow a term from Gould) between conscious fraud and objective data.

DeGusta and Lewis end on a celebratory note on the greatness of science (due one assumes to its methodological strength, as they see it, which voids the need for examining such tricky issues as individual motivation). Gould’s derives a very opposite caution from his examples. In examining the Morton episode and the other examples (Newton, Mendel), Gould finds lessons for the scientific community:

I do share the scientist’s faith that “correct” answers exist for most problems, and I believe that fudged data are paramount as impediments to solutions. I only raise what I regard as a pressing issue with two hopes for alleviation — first … we may examine our own activity more closely; second, that we may cultivate, as Morton did, the habit of presenting candidly all our information and procedure, so that others can assess what we, in our blindness, cannot.

In opposition to DeGusta and Lewis’s optimism in the ability of scientific method to limit the effect of the bias of scientists, Gould’s significantly more nuanced position (read the paper linked to above) evinces (as philosophers of science have done before) both the prevalence of (and I would argue the need for) “finagling” or fudging in scientific work and the consequent need to be cognisant of the implications of this fact.

DeGusta and Lewis claim to debunk Gould’s claims of error in Morton’s data. If the remeasurement and reanalysis carried out by Lewis is correct, all that demonstrates is that Morton does not serve as evidence of Gould’s thesis, not that Gould’s thesis is incorrect. Particularly since Gould himself offers additional example of fudging of data by scientists, and many more are available: see the controversy surrounding Eddington’s measurements to purportedly confirm Einstein’s theory of general relativity.

Scientists take short cuts (for practical as well as necessary reasons). They base these shortcuts on their beliefs and commitments (ontological, epistemological, political, so on). Science advances because results are held to be provisional, not because “truth is … obtainable” or “science … is self-correcting“. DeGusta and Lewis offer nothing towards contesting this finding of historians and philosophers of science (including Gould), nor do they offer any explanation of how scientific method auto-corrects errors in such shortcuts (unless of course all they mean by scientific method is the mundane processes, not exclusive to science, of examining prior assumptions and conclusions, checking for errors, rigour, so on… none of which equals “self-correcting“).


Posted Sep 5th, 2008 by ravi    / Permalink /

Posted Sep 3rd, 2008 by ravi    / Permalink /

To begin at the beginning (the latest beginning), the issue of women’s innate abilities at doing mathematics or science was offered as a possible reason for their under-representation in tenured positions at top universities in these fields, by Larry Summers, economics advisor to President Clinton and erstwhile president of Harvard University, in a speech (which he presciently deemed “provocative”) at the National Bureau of Economic Research. Listing other areas of under-representation (example: white men in the NBA), Summers urges:

These are all phenomena in which one observes underrepresentation, and I think it’s important to try to think systematically and clinically about the reasons for underrepresentation.

With this in hand, he proceeds:
Read More…

Posted Aug 28th, 2008 by ravi    / Permalink /

File this under awesome generalisations:

Face-Off: East vs. West — Zelkowitz 2008 (820): 3 — ScienceNOW


The eye-tracker confirmed that Westerners tend to dart from the eyes to the mouth and back again. Conversely, the East Asian students fixated on central points in the face, which the researchers believe enables them to view all its information at once, they report today in PLoS ONE. Both groups scored about the same on the recognition and categorization tasks, showing their methods were equally effective in identifying faces, Caldara notes. “In this difference, there is still something common and universal.”

Richard Nisbett, a psychologist at the University of Michigan, Ann Arbor, says the findings fit with other research on culture and visual perception. Speaking broadly, says Nisbett, people in East Asian cultures tend to prize collectivism and harmony above the individuality valued in Western cultures. These social values are so powerful, he says, that they may influence a trait biologists previously thought was hard-wired in our species.

Posted Aug 22nd, 2008 by ravi    / Permalink /

This post is the first in a series of ruminations that fall under the title offered (“Science and the public”).

An article in the New York Times brings up the fallout from recent resistance to vaccination:

Measles Cases Grow in Number, and Officials Blame Parents’ Fear of Autism –

More people had measles infections in the first seven months of this year than during any comparable period since 1996, and public health officials blamed growing numbers of parents who refuse to vaccinate their children.

Rather typically, the issue is immediately cast as a confrontation between two warring camps:

The language has changed, but the message is the same. Infectious disease prevention is to be feared. It is against the natural order of things. Instead of “vaccines are against God’s will”, it’s now “vaccines are against Nature’s will.” They’re “unnatural”, not “green”. In the old vernacular, interfering with God’s will could lead to “bad things”, like flood, famine, or other divine punishment. In the new language, it leads to “autism”.

Read More…