Dylan Tweney
Rough Drafts

Wikipedia’s reliability?

This morning, the WSJ ran a story on the Encyclopedia Britannica’s efforts to defend itself against assertions that it’s no more accurate than Wikipedia: WSJ.com – In a War of Words, Famed Encyclopedia Defends Its Turf Here’s the Nature study on Wikipedia vs Encyclopedia Britannica that kicked the w
Dylan Tweney 4 min read

This morning, the WSJ ran a story on the Encyclopedia Britannica’s efforts to defend itself against assertions that it’s no more accurate than Wikipedia: WSJ.com – In a War of Words, Famed Encyclopedia Defends Its Turf

Here’s the Nature study on Wikipedia vs Encyclopedia Britannica that kicked the whole thing off back in December.

A month ago I had discussed the topic with my dad, a cognitive psychologist who has spent a lot of time studying the scientist Michael Faraday. He was pretty unimpressed with Wikipedia, and did a comparison of its entry on Michael Faraday with Britannica’s. Here are Dad’s comments:

Yeah, I’d known about the “Nature” study, but it’s really pretty poor, IMHO.

First of all, they used only one expert per pair of articles. Wouldn’t surprise me if most of them could come up with pretty good guesses about which was which (this would probably work in Wikipedia’s favor, but it’s still a bias). Even so, one per pair is too few.

Second, that’s a pretty puny sample size of articles. At a maximum of 39 cents per letter ( x 50 = $19.50), assuming they used snail mail,  and some xeroxing, they could have done better for very little effort!

I redid my own short test (one I’d done a while ago) by looking up the articles on Michael Faraday in Wikipedia and in Britannica Online. The levels are very different, of course; the EB one is much longer and has some very abstract stuff in it. Even so, the comparison is startling.

Wikipedia’s is riddled with error, apparently most of it being based on a recent “fictionalized” biography of Faraday that simply invented stuff about his  motivations and that of other people, events that “must” have happened, conversations that “probably” occurred, and so on. Of course the qualifiers all disappeared in the article, and I now see, for example, Faraday credited as having invented the Bunsen Burner as his major achievement. What nonsense! Bunsen’s device was indeed based on Faraday’s research on flames, but he no more invented the burner than he invented the “Faraday Flashlights” now being sold all over eBay.

There are other mistakes even more serious, but I won’t bore you. The mistaken stuff about electricity, magnetism, and chemistry is frightening, never mind the hash made of the history. The links to other sources are just as bad — poorly chosen crap, for the most part.

The EB article was written by Pearce Williams, a major guy in the field. It was written some 15 years ago, so it errs on some small scholarly points, since resolved differently, but it has a masterful account of the science, and of Faraday’s life. The only big “error” is the attribution to Faraday of a strong influence by Boscovich. Again, not to bore you, but this was a hobby horse ridden by Williams for years, one that most scholars (me included) now think was overdone or flat wrong. But ’twas a heated controversy for a while, so one can perhaps forgive in retrospect. A major error, if that’s what it is, only to nitpicky historians. If I’d read this “blind”, I’d have guessed Williams was the author, I’m sure.

The EB article has surprisingly full references (but to heavy scholarly stuff, print media only) and links to good serious articles in the EB covering the physics and chemistry. Here again, a different level altogether — you wouldn’t send the average high school student to the EB for this. But if sent to Wikipedia, they’d of course be able to fully understand all the horseshit given there.

On balance, EB, hands down! You get what you pay for in this case!

I asked Dad why he didn’t just do the public-minded thing, and spend some time correcting Wikipedia’s egregious errors? From his response:

The EB article on Faraday was much longer than the one in Wikipedia, a factor of three, maybe. So that means there was 3 x the opportunity for an error in the EB article. If the sample of 50 entries in the Nature study was similar (i.e., longer EB articles), then the number of errors would really be skewed in Wikipedia’s favor. The way around this problem would be to compute the # errors per 1000 words, or some such. But then they would have had to be thinking like a scientist!

… Been mulling your point about correcting the Faraday article in W. Problem is, I’d have to write a whole new article! It’s not just a matter of changing factoids. Having just spent a month writing a bio of a psychologist for the “Dictionary of Scientific Biography” (for which Scribner’s is paying me! Hey, I’m a free lancer!), I know how much work would be involved to do it right.

I’ll keep mulling, but there is also the problem of whether those of us who do have some expertise should enhance an endeavor that is perpetuating misinformation, partial information, whatever. Thus, I looked at the Wikipedia article on Jonathan Edwards. Seems mostly o.k. factually (one minor error), but says nothing at all about his  philosophical  contributions, nor even the fact that he made any. His “great work on the Will” is mentioned, but no clue what it’s about, other than the book’s title. You do get links to lots of theological figures he was associated with (but not his most important predecessors), but the article is really about Edwards as a pastor. As with Faraday, the EB article is about 3 x longer, covers the topic very well, including the philosophical issues, as well as the theological. It’s a signed article by a real person (I don’t recognize the name, but he knows his stuff).
More from Dylan Tweney
Rough Drafts

Fifth Sun

Fifth Sun: A New History of the Aztecs by Camilla Townsend Camilla Townsend has pulled off a remarkable magic trick in this book, reconstituting the Mexica empire with an amazing level of detail and sensitivity. It makes the Aztecs feel like a real people, with a vibrant and complex culture, instead
Dylan Tweney 1 min read
Rough Drafts

The tree with the lights in it

Pilgrim at Tinker Creek by Annie Dillard My rating: 5 of 5 stars It took many months for me to finish reading this book, as I could only manage it in small doses. Dillard writes with an intensity level that starts around 7 or 8 and cranks up to 11 by the end of each […]
Dylan Tweney 1 min read


Subscribe to my newsletter on writing & storytelling

Great! You’ve successfully signed up.

Welcome back! You've successfully signed in.

You've successfully subscribed to Dylan Tweney.

Success! Check your email for magic link to sign-in.

Success! Your billing info has been updated.

Your billing was not updated.