January 12, 2016
I was a bit disappointed to hear David Attenborough on BBC Radio 4 this morning, while trailing a forthcoming documentary, telling the interviewing that you can determine the mass of an extinct animal by measuring the circumference of its femur.
We all know what he was alluding to, of course: the idea first published by Anderson et al. (1985) that if you measure the life masses of lots of animals, then measuring their long-bone circumferences when they’ve died, you can plot the two measurements against each other, find a best-fit line, and extrapolate it to estimate the masses of dinosaurs based on their limb-bone measurements.
This approach has been extensively refined since 1985, most recently by Benson et al. (2014). but the principle is the same.
But the thing is, as Anderson et al. and other authors have made clear, the error-bars on this method are substantial. It’s not super-clear in the image above (Fig 1. from the Anderson et al. paper) because log-10 scales are used, but the 95% confidence interval is about 42 pixels tall, compared with 220 pixels for an order of magnitude (i.e. an increment of 1.0 on the log-10 scale). That means the interval is 42/220 = 0.2 of an order of magnitude. That’s a factor 10 ^ 0.2 = 1.58. In other words you could have two animals with equally robust femora, one of them nearly 60% heavier than the other, and they would both fall within the 95% confidence interval.
I’m surprised that someone as experienced and knowledgeable as Attenborough would perpetuate the idea that you can measure mass with any precision in this way (even more so when using only a femur, rather than the femur+humerus combo of Anderson et al.)
More: when the presenter told him that not all scientists buy the idea that the new titanosaur is the biggest known, he said that came as a surprise. Again, it’s disappointing that the documentary researchers didn’t make Attenborough aware of, for example, Paul Barrett’s cautionary comments or Matt Wedel’s carefully argued dissent. Ten minutes of simple research would have found this post — for example, it’s Google’s fourth hit for “how big is the new argentinian titanosaur”. I can only hope that the actual documentary, which screens on Sunday 24 January, doesn’t present the new titanosaur’s mass as a known and agreed number.
(To be clear, I am not blaming Attenborough for any of this. He is a presenter, not a palaeontologist, and should have been properly prepped by the researchers for the programme he’s fronting. He is also what can only be described as 89, so should be forgiven if he’s not quite as quick on his feel when confronted with an interviewer as he used to be.)
Update 1 (the next day)
Thanks to Victoria Arbour for pointing out an important reference that I missed: it was Campione and Evans (2012) who expanding Anderson et al.’s dataset and came up with the revised equation which Benson et al. used.
Update 2 (same day as #1)
It seems most commenters are inclined to go with Attenborough on this. That’s a surprise to me — I wonder whether he’s getting a free pass because of who he is. All I can say is that as I listened to the segment it struck me as really misleading. You can listen to it for yourself here if you’re in the UK; otherwise you’ll have to make do with this transcript:
“It’s surprising how much information you can get from just one bone. I mean for example that thigh bone, eight feet or so long, if you measure the circumference of that, you will be able to say how much weight that could have carried, because you know what the strength of bone is. So the estimate of weight is really pretty accurate and the thought is that this is something around over seventy tonnes in weight.”
(Note also that the Anderson et al./Campione and Evans method has absolutely nothing to do with the strength of bone.)
Also if interest was this segment that followed immediately:
How long it was depends on whether you think it held its neck out horizontaly or vertically. If it held it out horizontally, well then it would be about half as big again as the Diplodocus, which is the dinosaur that’s in the hall of the Natural History Museum. It would be absolutely huge.
Interviewer: And how tall, if we do all the dimensions?
Ah well that is again the question of how it holds its neck, and it could have certainly reached up about to the size of a four or five storey building.
Needless to say, the matter of neck posture is very relevant to our interests. I don’t want to read too much into a couple of throwaway comments, but the implication does seem to be that this is an issue that the documentary might spend some time on. We’ll see what happens.
- Anderson, J. F., A. Hall-Martin and D. A. Russell. 1985. Long-bone circumference and weight in mammals, birds and dinosaurs. Journal of Zoology 207:53-61.
- Benson, Roger B. J., Nicolás E. Campione, Matthew T. Carrano, Philip D. Mannion, Corwin Sullivan, Paul Upchurch, and David C. Evans. 2014. Rates of dinosaur body mass evolution indicate 170 million years of sustained ecological innovation on the avian stem lineage. PLOS Biology 12(5):e1001853. doi:10.1371/journal.pbio.1001853
- Campione, Nicolás E., and David C. Evans. 2012. A universal scaling relationship between body mass and proximal limb bone dimensions in quadrupedal terrestrial tetrapods. BMC Biology 10:60 (22 pages). doi:10.1186/1741-7007-10-60
October 7, 2013
Suppose, hypothetically, that you worked for an organisation whose nominal goal is the advancement of science, but which has mutated into a highly profitable subscription-based publisher. And suppose you wanted to construct a study that showed the alternative — open-access publishing — is inferior.
What would you do?
You might decide that a good way to test publishers is by sending them an obviously flawed paper and seeing whether their peer-review weeds it out.
But you wouldn’t want to risk showing up subscription publishers. So the first thing you’d do is decide up front not to send your flawed paper to any subscription journals. You might justify this by saying something like “the turnaround time for traditional journals is usually months and sometimes more than a year. How could I ever pull off a representative sample?“.
Next, you’d need to choose a set of open-access journals to send it to. At this point, you would carefully avoid consulting the membership list of the Open Access Scholarly Publishers Association, since that list has specific criteria and members have to adhere to a code of conduct. You don’t want the good open-access journals — they won’t give you the result you want.
Instead, you would draw your list of publishers from the much broader Directory of Open Access Journals, since that started out as a catalogue rather than a whitelist. (That’s changing, and journals are now being cut from the list faster than they’re being added, but lots of old entries are still in place.)
Then, to help remove many of the publishers that are in the game only to advance research, you’d trim out all the journals that don’t levy an article processing charge.
But the resulting list might still have an inconveniently high proportion of quality journals. So you would bring down the quality by adding in known-bad publishers from Beall’s list of predatory open-access publishers.
Having established your sample, you’d then send the fake papers, wait for the journals’ responses, and gather your results.
To make sure you get a good, impressive result that will have a lot of “impact”, you might find it necessary to discard some inconvenient data points, omitting from the results some open-access journals that rejected the paper.
Now you have your results, it’s time to spin them. Use sweeping, unsupported generalisations like “Most of the players are murky. The identity and location of the journals’ editors, as well as the financial workings of their publishers, are often purposefully obscured.”
Suppose you have a quote from the scientist whose experiences triggered the whole project, and he said something inconvenient like “If [you] had targeted traditional, subscription-based journals, I strongly suspect you would get the same result”. Just rewrite it to say “if you had targeted the bottom tier of traditional, subscription-based journals”.
Now you have the results you want — but how will you ever get through through peer-review, when your bias is so obvious? Simple: don’t submit your article for peer-review at all. Classify it as journalism, so you don’t need to go through review, nor to get ethical approval for the enormous amount of editors’ and reviewers’ time you’ve wasted — but publish it in a journal that’s known internationally for peer-reviewed research, so that uncritical journalists will leap to your favoured conclusion.
Last but not least, write a press-release that casts the whole study as being about the “Wild West” of Open-Access Publishing.
Everyone reading this will, I am sure, have recognised that I’m talking about John Bohannon’s “sting operation” in Science. Bohannon has a Ph.D. in molecular biology from Oxford University, so we would hope he’d know what actual science looks like, and that this study is not it.
Of course, the problem is that he does know what science looks like, and he’s made the “sting” operation look like it. It has that sciencey quality. It discusses methods. It has supplementary information. It talks a lot about peer-review, that staple of science. But none of that makes it science. It’s a maze of preordained outcomes, multiple levels of biased selection, cherry-picked data and spin-ridden conclusions. What it shows is: predatory journals are predatory. That’s not news.
Speculating about motives is always error-prone, of course, but it it’s hard not to think that Science‘s goal in all this was to discredit open-access publishing — just as legacy publishers have been doing ever since they realised OA was real competition. If that was their goal, it’s misfired badly. It’s Science‘s credibility that’s been compromised.
Update (9 October)
Akbar Khan points out yet more problems with Bohannon’s work: mistakes in attributing where given journals were listed, DOAJ or Beall’s list. As a result, the sample may be more, or less, biased than Bohannon reported.
April 12, 2012
As everyone now knows, last week the respected and trusted Today programme on BBC Radio 4 ran an absurd nonscience piece on Brian Ford’s wild, ignorant, uninformed speculation that all dinosaurs lived in shallow lakes because that was the only way they could support their weight. Plenty of people have shown what utter, contemptible nonsense this is, and I won’t waste everyone’s time by reiterating it.
Inspired by a comment by Stephen Curry, I put together a request for a formal retraction, and solicited signatories from the VRTPALEO list and Dinosaur Mailing List during a 24-hour window. During that time 20 palaontologists contacted me to sign, and so this is what I submitted at 3pm on Thursday 5th April:
Dear Radio 4,
The Today Programme for Tuesday 3rd April 2012 contained a science piece by Tom Feilden:
regarding Professor Brian J. Ford’s “theory” that dinosaurs did not live on land but in shallow lakes which supported their weight.
Professor Ford’s theory was published in a magazine rather than a peer-reviewed journal, and is wholly unsupported by any evidence whatsoever. It contradicts all evidence from dinosaur anatomy, biomechanics, sedimentology and palaeoenvironments, and does not even qualify as fringe science. It is unsupported and uninformed speculation which Ford could have disproved had he taken just ten minutes to look at the readily available literature representing a century of consensus.
By giving air-time to this speculation, even comparing Ford with Galileo, Radio 4 has unfortunately lent it a credibility that it has not earned, introduced a time-wasting controversy where there is not a controversy, misled the public, and maybe most importantly compromised its own credibility as a trusted source of science reporting. No listener with any knowledge of palaeontology will have been able to take this report seriously; will they believe the next science report you broadcast?
To mitigate this damage, we recommend and request that you broadcast a formal retraction.
- Dr. Mike Taylor, Department of Earth Sciences, University of Bristol, UK
- Dr. David Marjanović, Museum für Naturkunde, Berlin, Germany
- Silvio C. Renesto, Associate Professor of Palaeontology, Department of Theoretical and Applied Sciences, Università degli Studi dell’Insubria, Italy
- Dr. Grant Hurlburt, Department of Natural History, Royal Ontario Museum, Canada
- Dr. Michael Balsai, Department of Biology, Temple University, Philadelphia, USA
- Dr. Bill Sanders, Museum of Paleontology, University of Michigan, USA
- Dr. Stephen Poropat, Department of Earth Sciences, Uppsala University, Sweden
- Dr. Oliver Wings, Curator of Vertebrate Palaeontology, Museum für Naturkunde, Berlin, Germany
- Jon Tennant, Independent Researcher, UK
- Prof. John R. Hutchinson, Department of Veterinary Basic Sciences, The Royal Veterinary College, UK.
- Prof. Lorin R. King, Dept. of Science, Math and Physical Education, Western Nebraska Community College
- Scott Hartman, paleontologist and scientific illustrator, SkeletalDrawing.com
- Neil Kelley, Department of Geology, University of California at Davis, USA
- Dr. Matteo Belvedere, Department of Geosciences, University of Padova, Italy
- Andrew R. C. Milner, Paleontologist and Curator, St. George Dinosaur Discovery Site, Utah, USA
- Dr. James I. Kirkland, State Paleontologist, Utah Geological Survey, USA
- Dr. Jerry D. Harris, Director of Paleontology, Dixie State College, Utah, USA
- Dr. Andrew A. Farke, Curator, Raymond M. Alf Museum of Paleontology, Claremont, California, USA
- Dr. Daniel Marty, Editor (Palaeontology) of the Swiss Journal of Geosciences
- Dr. Manabu Sakamoto, School of Earth Sciences, University of Bristol, UK
(My thanks to all who signed.)
To give it the best chance of being seen by the relevant people, I submitted this three times on the BBC’s rather confusing web-site: on the Today feedback page, on the BBC complaints page, and on the Contact Today page.
Today at 2pm, I got the following reply:
Dear Dr Taylor
Thanks for contacting us regarding ‘Today’ broadcast on BBC Radio 4 on 3 April.
I understand that you were unhappy with the inclusion of a report by Tom Feilden on a theory proposed by Professor Brian Ford regarding how dinosaurs’ lived. I note you believe the report gave credibility to this theory, and compared the professor with Galileo.
Your concerns were forwarded to the programme who explained in response that the item in question was a light-hearted feature looking at an outlandish new idea about the dinosaurs and which was clearly signposted as such.
They added that the item even included one of the world’s leading experts on dinosaurs, Paul Barrett, exposing it’s flaws and ridiculing it and that it was very clear where Brian Ford’s article was published since Laboratory News was clearly mentioned.
They also added that the reference to Galileo was simply an aside about the importance of dissent in science, with Brian Ford was unlikely to be put off by the condemnation of the established experts, and not, as you suggest, a comparison between Brian Ford and one of the greatest scientists of all time.
In closing they explained:
“Today does a lot of good, serious science, indeed that same morning we had items on carbon capture and storage and the controversy over the publication of flu research, but that doesn’t mean it all has to be serious and we must be free to include light-hearted items, reported in a more humorous way.”
Nevertheless, we’re guided by the feedback we receive and I can assure you I’ve registered your complaint on our audience log. This is a daily report of audience feedback that’s made available to all BBC staff, including members of the BBC Executive Board, channel controllers and other senior managers.
The audience logs are seen as important documents that can help shape decisions about future programming and content.
Thanks for taking the time to contact us.
I guess I don’t need to say that I find this completely unsatisfactory. Trying to pass the segment off as “a light-hearted feature looking at an outlandish new idea about the dinosaurs and which was clearly signposted as such” just won’t fly: its page on the BBC site is entitled “Aquatic dinosaur theory debated”, and there is nothing about it that signposts it as any less serious than, say, the piece they did with me on Brontomerus, or on sauropod neck posture.
As it happens, my mum called me for a chat a couple of days ago, asking me whether I’d heard “the new theory” on the Today show. It was pretty painful having to let her down. She obviously didn’t hear it as “a light-hearted feature”. It’s going to be harder now for her to accept other science reporting on Today.
The response claims that “the reference to Galileo was simply an aside about the importance of dissent in science […] and not, as you suggest, a comparison between Brian Ford and one of the greatest scientists of all time”. Well, let’s take a listen and see what exactly was said:
Somehow, I don’t think that [Paul Barrett’s gentle disagreement] is going to be enough to persuade Professor Brian Ford. As another famous scientific dissenter, Galileo, was reported to have to have muttered under his breath when forced to deny that the Earth revolves around the Sun, “Eppur si muove” — “And yet, it moves“.
This is just so disappointing. It would have taken Today‘s Tom Feilden five, maybe ten minutes of high-school-level research to discover that Ford has no grounding in palaeontology, sedimentology, biomechanics or palaeoenvironments; that his “theory” is as emphatically contradicted by the evidence as geocentricism; and that its publication was in a trade newsletter. By skipping that basic due diligence, and blindly reporting Ford’s fantasy as serious science, Today has dramatically undermined its own credibility; by refusing to retract or even apologise, they’ve missed a chance to regain some of that lost credibility.
Why does it matter? Scott Hartman said it best:
We live in a world where huge swaths of people don’t understand basic scientific concepts, and this sort of nonsense just makes it harder to teach. Worse, listeners that were sympathetic to the reporting will become disillusioned when they find out the reality of the situation, possibly making them view all science more cynically (or simply avoiding science altogether).
We deserve better science reporting than this. The BBC and everyone else who carried this story should be ashamed.
October 12, 2011
Folks. Just don’t do this. Just don’t.
McMenamin and Schulte McMenamin’s crack-smoking GSA abstract Triassic kraken: the Berlin ichthyosaur death assemblage interpreted as a giant cephalopod midden isn’t going to do anything for them except attract well-deserved ridicule; and it’s not going to do anything for the field of palaeontology except attract undeserved ridicule. It’s a lose-lose.
So just don’t, OK?
Oh, and, Geological Society of America? Don’t do this, either. A reputation is a valuable and fragile thing.
And mainstream media: we understand that you feel you should be able to trust the Geological Society of America, but can please have just a little common-sense?
(Actual analysis, if anyone wants it, can be found here on Brian Switek’s Wired blog.)
April 1, 2010
This is an actual page from the late, lamented Weekly World News, from December 14, 1999. I always thought it was pretty darned funny that they had the alien remains discovered in the “belly” of an animal known only from neck vertebrae. Now, subjecting a tabloid story to technical scrutiny really is like dancing about architecture, but…it just tickles me. As does the entire story. I haven’t been able to get hold of Dr. Posvby to confirm his findings, but it’s been over a decade and he still hasn’t published, so I’m not holding my breath.
December 17, 2009
Great news! I just got off the phone with someone at the Discovery Channel. He asked not to be named, but he has responsibility for Clash of the Dinosaurs and the authority to do what he promised, which is to fix the “second brain” segment exactly as I asked in the previous post! He said that the program would not be broadcast again until that segment was fixed, and that the fixed version would be in the DVD/Blu-ray release.
So, this is about the best and fastest outcome that I could have asked for. When I put up the last post, I didn’t know whether to expect broad support at the positive end of the spectrum, or a (probably unenforceable) cease-and-desist order at the negative end. I didn’t dare to hope that the problem would be solved so quickly and decisively. Many thanks to the folks at the Discovery Channel for taking responsibility and doing the right thing here.
Looking back: how does this happen?
In the past few days I have been contacted privately by several scientists who have worked or are working on documentaries, and most of them had the same complaint: although some individuals or teams of people at the production companies really care about getting things right, the show is almost always forced to follow a predetermined script or at least hit on certain predetermined points, and it is essentially impossible for the scientific advisors to change the courses of these things. I’ve experienced this firsthand on more than one project now and I can verify that this is how things are done routinely.
Where are the predetermined stories coming from, screenwriters, producers–who? Why aren’t the stories coming from the scientists? When the predetermined stories collide with what the scientific advisors have to say, why do the predetermined stories trump the science? That’s a bass-ackwards way to make a documentary. But this isn’t an infrequent anomaly. This is business as usual in the world of science documentaries.
(From everything I’ve seen and heard, NOVA is a shining exception; I suspect that extends to most documentaries that are commissioned by PBS instead of commercial cable outlets.)
You can see how this practice can’t do anything other than distort the science that the shows are purporting to deliver; as long as something other than the science has priority when it comes to content, it can’t possibly be otherwise. It’s a simple matter of priorities.
Commercialism vs science…or rather, not
And before some commenter says it, I know these companies are in business to make money, not to serve as some kind of selfless science dole. I disagree violently with the suggestion that commercial concerns force them to make bad documentaries, or that there is any necessary conflict between accuracy and entertainment. The real stories are more interesting and more exciting anyway. Exhibit A: David Attenborough’s entire career. End of discussion.
It was all an innocent mistake
In comments on the previous post, the idea was mooted a couple of times that what I’d said in the interview was sufficiently complex and the editors were sufficiently harried that this could just be a simple misunderstanding.
I have three problems with this. First, I don’t see how I could have been any clearer about the second brain business. I said “For a while it was thought that X. There are a couple of misconceptions there.” How anyone could possibly get from that I subscribe to X is quite beyond me.
Second, it had been clear for months that the folks at Dangerous wanted to include the second brain business. The idea that it was a simple misunderstanding by a single editor is contradicted by the pattern described above, wherein documentary makers often seize on certain weird ideas and absolutely won’t be dissuaded no matter what the scientists say. Dangerous wanted a clip of a scientist describing the second brain, and they got it…after a fashion.
Third, the “innocent mistake by harried editor” hypothesis is Pyrrhic exculpation. I’ll explain that.
When I was a grad student at Berkeley, we had a situation once in which a student plagiarized an entire termpaper. When she was called into the course director’s office, she started to explain that she’d only done it because she’d been so busy, and there were extenuating circum–and the course director, who was also my advisor, cut her off right there. He told her that it was actually far more damaging to her credibility to blame her plagiarism on being busy, because what she was indirectly suggesting is that anytime she got busy, she’d default to cheating. That would be turning a one-time screwup into a potentially recurring pattern of behavior, and a bad decision into a facet of her character. In short, the excuse was far worse than the actual crime.
I think the same applies in the case of the dishonest editing. In the view that I’d prefer to believe, there was institutional pressure to deliver a quote on the “second brain”, and an editor made the cut either on his own or because a producer told him to. There is still a component of institutional screw-up, because of the pressure to deliver a quote on one of these predetermined script points no matter what the interviewee said, but this could still be a one-off by one or two people. In the “innocent mistake by harried editor” defense, documentary editors have to work so hard and so fast that sloppiness to the extent of completely reversing an interviewee’s testimony is inevitable, at this company and throughout the industry. Maybe I’m being dense, but how is that better?
Looking forward: where do we go from here?
There is at least one big institutional problem with the way that many documentaries are made, which is that the scientific advisors are basically there to prop up an often deeply flawed script composed without their input. Depending on who you listen to, there may also be an institutional problem in that the editing of these shows is practically guaranteed to result in quote-mining. So what do we do?
First, I agree with many commenters here and elsewhere that scientists ought to demand some level of input into the script, and the right to review any footage of them that goes into the final product. This is tough, because it may be hard to turn down a gig with lots of publicity when you’re on the job market or clawing for tenure, and even if you say no, the production companies can keep calling other people until they get someone who says yes. Hopefully if they get turned down a few times, it will start to dawn on them that making up the show (often in more ways than one!) without any input from the scientists is stupid and wrong.
There have been calls on the DML and elsewhere to create some kind of body that could oversee these things. On one hand, I can see lots of barriers to making that work; on the other hand, if such a body could be brought into existence, production companies might go out of their way to earn their imprimatur. Or better yet, networks like BBC and the Discovery Channel might start insisting that documentaries in that area get the approval of the scientific oversight body. I know, I know, it sounds impossibly optimistic, and I don’t expect it to happen, but stranger things have happened, some of them just this morning.
Second, when documentaries come out, they need to be critiqued, by anyone with knowledge to contribute (the Wikipedia/DML model), by degreed professionals (because authority still carries some weight), and especially by the scientists involved. Production companies might not take such a cavalier attitude toward accuracy if they knew their work was going to be publicly scrutinized by the very scientists they were getting to appear on camera.
Third, we have to avoid becoming complacent, and by ‘we’ I mean scientists and audience members alike. A few doom-and-gloomers have suggested that this is just how Big Media works, and I need to stop being young and naive and simply accept it. I say, sod that. We will get the programming we demand. The internet is a very long lever, and I think that if we all push together, we can move the world.
Fellow Padian lab grad, elephant wrangler, and general nice guy and scientific badass John Hutchinson came through with a boatload of good advice in a comment below. I didn’t want it to be overlooked, so I’m just going to repost it here. Thanks, John!
One practice I recommend is to ensure you always charge production companies for your time, including time spent on emails and the phone. Almost all of them have a budget for this but of course they won’t tell you. How much you charge is negotiable; $100/hr is not unusual and it is possible to charge more. I do this and have the money go straight into my research slush funds, funding grad student trips to conferences etc.
If you’re up front about this (I tell them on the first call/email that my time is money and make an agreement) then they will tend to be more efficient with their time and at least at the end of the experience you’ll have a concrete benefit. In cases where you’re putting in a lot of time, get a contract signed; universities/museums may have business development people that can help arrange this.
In general the media will try to get as much out of you for free as they can. Be mindful of this. To be cynical/realistic, the companies don’t really care about you, even if the researchers do and are very nice chaps. Normally I am appalled by taking a mercenary attitude in science, but this is one case in which I am not.
A caveat is that companies in the early stages of documentary development may not yet have funds or even a guarantee that a filmed show will come out of it. In that case they will expect pro bono help. As a large fraction of these efforts tend to go under (not get funded), I recommend being careful with such situations- I’ve been disappointed 4/5 of the time.
The same goes once filming begins; if you spend 8 hrs filming you’d better get paid, because there is still a big chance that the footage will end up on the cutting room floor or just ~5 min will be used.
I tend to demand to see the script (when I don’t forget to ask, anyway)- and remember you can deviate from it. Much is negotiable but you have to be firm and persistent. It can be excruciating.
Once you get on the “hot list” from doing a few dino docs, you tend to more and more calls for help; I get about one a month on average (once four in one month). So the pressure to say yes reduces. Be choosy and don’t be afraid to say no.
Also, many, many thanks to all of you who took up the cause, either by blogging or by getting in touch with Dangerous, Zodiak, and Discovery. I couldn’t sleep after the previous post, I was afraid that I’d brought a knife to a gun fight. Considering how quickly and painlessly this was resolved, now it looks more like bringing a bazooka to a school debate. But I didn’t know that at the time. And as Carl Zimmer pointed out, happy endings like this one are few and far between.
Finally, as happy as I am that the bad editing is going to be fixed, let’s not lose sight of the larger problem. Clash of the Dinosaurs is still a pretty lousy show, especially considering the time and effort that went into it. All of the companies involved should be aspiring to do a hell of a lot better. We have a long way to go and hand-wringing about the likely education level of the average viewer is not going to get us there. I firmly believe that it is possible to present science accurately without losing the audience. The challenge is to get the people who make documentaries to believe that, too.
Right after I saw the show Sunday night, I wrote to the folks at Dangerous Ltd to point out their dishonest editing and to request an explanation (if you have no idea what I’m talking about, read this first). Today I finally got a response.
The message didn’t come with any formal or informal requests or warnings about not forwarding or reposting it whole or in part. It’s not all relevant so I won’t quote the whole thing, but it contains the evidence that proves that my claim against Dangerous Ltd is accurate, so I am posting the relevant bits.
For now, can I express our unreserved apologies for the clear fact that we incorrectly spelled your name in the show.
There follows a fairly long and complicated recounting of internal errors and miscommunications. There is no mention of whether this is something that could be fixed in future broadcasts or in the DVD/Blu-ray release. But the apology is something, at least.
I believe you are also right in pointing out that Sauroposeidon was written incorrectly as Sauroposeiden in one of the ‘quiz bits’. I’m sorry to say that the quiz bits at commercial time were produced by Discovery, and although this part of the production process was beyond our control the least I can do is offer another apology.
I knew that this was probably the fault of the Discovery Channel and not Dangerous, which is why I was careful to mention in the last post that it was something presented alongside the show and not as part of the show. There were other godawful quiz bits in the same broadcast, which is one reason I am not as quick to absolve the Discovery Channel of all responsibility for the failings of Clash of the Dinosaurs. I acknowledge that some of the shows they broadcast are quite good, but many others are terrible. In my opinion, the low quality of both Clash of the Dinosaurs and the quiz bits aired along with it are symptomatic of a general apathy toward scientific rigor at Discovery Communications; I don’t think that anyone with two neurons to rub together will be shocked by that statement.
Still, nice of them to apologize on behalf of the Discovery Channel; it’s a lot more than I’d get later on.
Now we get into the real meat:
As for the greater part of your concerns, re the part of the show concerning suggestions involving Sauroposeidon, I’ve taken a careful look at what you originally said compared to what was finally aired. In the original interview, you said:
Matt 14.45.08 Ok one of the curious things about saurapods is that they did have a swelling in the spinal chord in the neighbourhood of their pelvis. And for a while it was thought that may be this was sort of like a second brain to help control the back half of the body. Erm there are a couple of misconceptions there. One is that most animals control large part of their body with their spinal chord. If you’re going through day to day operations like just walking down the street and your minds on something else your brain isn’t even involved in very much controlling your body. A lot of that is a reflex arc that’s controlled by your spinal chord.
Quick aside: the technical term I was groping for here is not “reflex arc” but “central pattern generator”.
So its not just dinosaurs that are controlling their body with their spinal chord its all animals. Now the other thing about this swelling at the base of the tail is we find the same thing in birds and its called the glycogen body. It’s a big swelling in the spinal chord that has glycogen which is this very energy rich compound that animals use to store energy. Problem is we don’t even know what birds are doing with their glycogen bodies. Er the function is mysterious – we don’t know if the glycogen is supporting their nervous system – if its there to be mobilised help dry [should be ‘drive’ -ed.] their hind limbs or the back half of their body and until we find out what birds are doing with theirs we have very little hope of knowing what dinosaurs were doing with their glycogen bodies.
You can understand that a TV show for Discovery doesn’t always have the room to expand a complex argument. It must also accommodate the needs of all sections of the audience (including children) and while it must educate, it must simultaneously hold everybody’s attention. This said, this doesn’t mean there’s room for error. In the transcript of the final edit, you appeared to be saying:
One of the curious things about Sauropods is that they did have a swelling in the spinal cord, in the neighborhood of their pelvis. This was sort of like a second brain to help control the back half of the body.
There it is in black and white. I was very clearly explaining why a misconception is no longer held, and they edited the tape to make me regurgitate the misconception as if it was not just a commonly accepted fact, but a fact that I accepted. That is beyond quote-mining, it is the most blatantly dishonest thing that you can do with someone’s recorded words. Let’s see what they have to say about it (quote continues with no omissions):
In your email, you said: ‘Someone in the editing room cut away the framing explanation and left me presenting a thoroughly discredited idea as if it was current science.’ In your interview you carefully set out a context in which you made your argument, a context that was perhaps not included in the show as carefully as it could have been. Whether this was in the interests of brevity or not, I entirely appreciate your position. We had no wish to suggest you were presenting an old, discredited argument, we were simply working on the show ever aware of the demands of our audience. This does not excuse a part of the program which was perhaps not edited with as much finesse as it could have been and consequently I will make your concerns clear to the production team in the hope that we may avoid such situations again.
While I hope this clarifies our position, I will endeavour to call you to ensure all your concerns are properly heard.
Notice that there is not even a whiff of an apology anywhere in here. They were “ever aware of the demands of [the] audience”, this part “was perhaps [!] not edited with as much finesse as it could have been”, and they’re going to try to do better next time.
This is crap, crap, crap, just total crap from top to bottom. If you have a segment of an interview that covers ground that you decide is too complex for the audience, JUST DON’T AIR IT. Or, if you insist on presenting this very old and very stupid idea is if it is accurate and current, LEAVE ME OUT OF IT. But the one thing you don’t do is mangle my words to make it sound like I support it. And if you do commit that catastrophically stupid and unethical action, have the decency to apologize! Perhaps they didn’t because that would count as an admission of guilt?
This is not a joke and it is not a minor infringement. This is the broadest publicity that I have ever gotten or may ever get, the description of Sauroposeidon included. This is my professional competence and reputation on the line. This is not just careless editing, this is Dangerous Ltd deliberately making a liar out of me in front of millions of people.
This is intolerable.
What I’m Going To Do
I’m going to write back to Dangerous Ltd and request a copy of the release that I signed, to see what legal rights, if any, I may have to get this fixed. What would fixing it entail? Simple: I don’t care if they leave in the bit where they discuss the “second brain”, just cut out my speaking part. It’s probably all of ten seconds. They could even replace it with something or someone else, I don’t care. Just stop making me lie. I’d prefer to see that edited version replace the one currently in circulation, both for future broadcasts and for the DVD/Blu-ray release.
If they could fix my name while they’re at it, that would be nice, but it’s really small potatoes. “Matthew” Wedel is a dumb error, but it’s just an error. What they did in the ‘second brain’ segment is a lie, and one that is corrosive to my public credibility.
How You Can Help
Send this on to everyone you think might be interested, which potentially includes everyone who watches the Discovery Channel or likes dinosaurs. In particular, copy and paste the quoted section above that includes the transcript of my interview; the best hope for me in the long run is for this evidence to be backed up in so many places that it can never be suppressed. I have no idea about the legal status of a chunk of text copied from an e-mail message to a blog post to someplace else on the internet. I care far more that what is posted here and elsewhere matches what Dangerous Ltd has on file; the latter ought to be subject to subpoena even if the former is not. Fellow bloggers and science bloggers, I’m asking for your help.
Dangerous Ltd turned my words around 180 degrees because they had to “accomodate the needs of the audience” and “hold everyone’s attention”. This shows stunning contempt for the audience, for the scientists who appeared on the show, and for the truth. Coming from a company that makes documentaries, I think it’s about the most damning statement possible. If you’re working with them, maybe it’s time to reconsider.
You, reading this post: you are the audience. If you disagree with the idea that Dangerous Ltd has to subvert the truth to hold your attention, or if you’d like to support my request that they fix the show by removing the dishonestly edited portion, please contact them here. I shouldn’t have to say it, but this is the net, so: if you do contact them about this, please be brief, stick to the facts, and don’t be abusive, threatening or profane.
I’ve already e-mailed all of the top officers of Dangerous Ltd and this non-apology is the closest to an official response that I’ve gotten or expect to get. It might also be worthwhile to contact Zodiak Entertainment, the parent company of Dangerous Ltd, and make sure that they are aware of how their subsidiary is representing them. You may do so here; the previous plea for brevity and moderation applies.
Finally, outfits like Dangerous Ltd will only be able to pull this kind of crap for as long as Discovery Communications lets them get away with it. The most relevant thing I’ve been able to find for them is the Viewer Relations contact page for Discovery.com, which is here. Please let them know how you feel–briefly and politely, as always.
Many, many thanks to everyone who has written to me or commented here and elsewhere to show their support. The only way to get better science programming is to demand it. Please speak up!
UPDATE, about 1.5 hours after posting
Mike just pointed me to a post on the publicly archived VRTPALEO Mailing List by Alex Freeman, a BBC employee, that is highly relevant to my situation and maybe even crucial (I can’t link to it yet because the day’s posts haven’t been archived yet, but I will add it as soon as possible). Here’s the good bit:
I’d like to make clear that the BBC has a code of conduct which covers all of its output. Fair representation of contributors is extremely strictly regulated and if anyone ever made edits like those described they would very quickly be out of a job, and the BBC would have to make a public statement and apology.
First question is, does Discovery Communications have a similar code of conduct (that they are willing to enforce in this case)? Second question is, when is Clash of the Dinosaurs slated to air in the UK, and will it be on the BBC? Dangerous, Zodiak, or Discovery may be willing to fix the problem on their own steam, and I want to give them the opportunity to do so. But if they won’t, hopefully the BBC will have both the clout and the will to get the job done.
Needless to say, this code of conduct would be a useful thing to mention in any communication to Dangerous Ltd, Zodiak Entertainment, or the Discovery Channel.
UPDATE, the next day
The Discovery Channel came through; they will not air the show again or release it on disc until the dishonest editing is fixed.