At the risk of repeating myself: more on AltMed journals
The day after I put up the rambling post on AltMed journals, Badscience Guru Ben Goldacre’s definitive five-star demolition of homeopathy ran over several pages of The Guardian and on the Badscience blog.
The resulting comments thread at Badscience.net spawned the occasional defender of homeopathy, but what caught my eye was the one, calling him/herself Budicius, who wrote as follows:
“I get bored to tears with the same old rigmarole from sceptics. To say that Homoeopathy is nothing but placebo is an uneducated and ludicrous comment… …Look at www.liebertonline.com at the article - “Efficacy of the potentized Drug, Carcinosin 200 fed Alone and in combination with another drug - Chelidonium 200, in Amelioration of p-Dimethylaminoazobenzene- induced Hepatocarcinogenisis in Mice”. These Homoeopathic drugs have been diluted two hundred fold and are successful in the treatment of and inhibition of Hepatic carcinogens.”
- The abstract of the paper, which appeared in the Journal of Alternative and Complementary Medicine (henceforth “JACM”) is on Pubmed here.
And a little later:
“I found another one with favourable results. “Amelioration of Carcinogenesis Induced Toxicity in Mice by Administration of a potentized Homoeopathic drug, Natrum Sulphuricum 200″ This one is at ecam.oxfordjournals.org”
- this study, which is from the same authors as the other one s/he cites, is in Evidence-based Alternative and Complementary Medicine and can be found, with link to the free full-text version, here.
*Sigh*. Just in case anyone found the last post on AltMed journals too verbose, let me re-state it in simple language. In my experience, studies published in such journals of “Alternative Medicine” (or complementary, or integrative, or whatever other studiedly neutral term they are camouflaging themselves with this year) usually turn out to be so flawed as to be scientifically valueless. IMHO this is because the standards of “expert peer review” at AltMed journals like OUP’s eCAM, and Liebert’s JACM, are, to put it very mildly, debatable. Or more trenchantly, a joke.
The Modus Operandi in these journals, as I was trying to convey with my analysis of the Mellow Rats in Pyramids paper, seems typically to be as follows:
(i) Carry out poorly-controlled experiment into “alternative modality”;
(ii) Resolutely ignore all negative findings (always assuming your publication bias means that you bother reporting them in the first place);
(iii) Resolutely ignore any and all possible confounding factors that could affect the results- instead:
(iv) Attribute any “positive” results to mystic effect of homeopathic remedy / pyramid / Reiki energy field;
(v) Publish in AltMed journal where “expert peer reviewers” ignore lack of controls in (i), repeat one-eyed (ii) and (iii) and unquestioningly accept daft interpretation in (iv), because they share your belief in mystic nonsense.
Pure Cargo Cult Science. It clothes itself in the appearance of science, but utterly lacks the critical ingredient of necessary scepticism. What you get instead is a collective act of suspension of critical thinking, and indeed of implicit belief in magic.
Clearly I am generalising, but every time I read a paper in one of the AltMed journals that claims to provide “scientific evidence for homeopathy” (or similar), this is what I see.
BTW, the editor in chief of the JACM is Professor Kim Jobst (brief bio here). Kim Jobst is a medical homeopath, was a founding Council Member of the Prince of Wales’s Foundation for Integrated Health, and was for several years (see post below from David Colquhoun) a Visiting Professor of “Healthcare and Integrated Medicine” (that I-word again) at Oxford Brookes University. Apart from editing the JACM, he is best known in the Badscience world for his endorsement of the laughable qLink “anti-EMF” pendant, a medical marvel (not) thoroughly debunked by Ben Goldacre here.
To re-iterate the point. Here is a journal whose Editor-in-Chief seems to believe a device containing no active electrical components can nonetheless have health effects by producing a mysterious “Sympathetic Resonance” effect hitherto unknown to biology.
Given this, how is one to believe the said journal and its “expert reviewers”use any meaningful scientific standards in deciding what to publish?
PS In case Shpalman or any other proper physicist is reading, and would like to engage with the qLink and how it claims to work, the manufacturer offers an explanation here
November 17, 2007 at 7:35 pm
Huntsman, a poster on the JREF forum used to have a signature reading “Science is the process of crash testing ideas: you ram the idea head-on into a brick wall at 60mph, and knowledge is gained by examining the pieces. If the theory is solid, the pieces are from the wall. Then we build a bigger wall.”
The AltMed journals don’t try hard enough to break the ideas.
November 17, 2007 at 8:27 pm
Thanks for the reposting with correct links. I looked at the explanation of qLink, and despite having studied some quantum mechanics in my University days, remain unconvinced that anyone can produce a gadget that focuses “subtle” forces which “cannot be observed or measured by any known instrumentation.”
My simple point is that if you can’t sense them in any way how the heck can you do anything with them?
I know we don’t really know what gravity is, but at least we see its effects.
November 17, 2007 at 9:33 pm
Hold on, the drugs “have been diluted two hundred fold”? That’s not homeopathic — people dilute conventional medicines more than that. A lot of them’d be lethal if you didn’t.
November 19, 2007 at 2:59 pm
When I came across the qLink pendant on Badscience several months ago, I found to my embarrasment that four of the “scientific studies” the manufacturer listed not only originated from my home country (Austria), but two of them even from the university I studied at (U Vienna). I used these - amongst others - as examples of the involvement of even university based researchers in financially promising pseudosciences in an article in a widely read Austrian newspaper. http://derstandard.at/?url=/?id=2975156
Only one of the four study authors bothered to reply. It seems several years ago he undertook some efforts, even legal ones, not to let his name be associated with the qLink pendant. Only partly effective, however. The other one did a statistical evaluation of some obvious quack data, and while the statistics are fine, I am sure he knew what was really going on.
When looking up the names associated with the pseudoscientific gadgets I was amazed to find how many of those where homeopaths or more general CAM practitioners…
November 20, 2007 at 12:21 pm
Andrew - the “two hundred fold” comment was from Budicius, not Dr Aust.
I presume it means 200 C homeopathic dilutions i.e about 1 * 10 -400 (can’t figure out superscript).
November 22, 2007 at 8:10 pm
Concerning Kim Jobst. I recently submitted an FoI request to Oxford Brookes, hoping to see the documents relating to his appointment as a visiting professor.
It seems he was a visiting professor from 1999 to 2004. I was told on Sept 10 2007
So it seems that Oxford Brookes are doing a bit better than the University of Teesside.
November 22, 2007 at 8:26 pm
Thanks for dropping by, Ulrich.
Haben Sie vielleicht gedacht, ihren Q-link Artikel in Englisch uberzusetzen?
- I don’t know that I have seen any info in English on the “research” cited by qLink, and it sounds quite interesting.
By the way, Frau Dr Aust, die aus tiefsten Oberbayern stammt, says she thinks the South German and Austrian mindset is often quite susceptible to mystic mumbo-jumbo.
Herzlichen Glückwunsche zu ihre Dr Oec Habil
November 23, 2007 at 9:55 am
Thanks for the info on “Prof” Kim Jobst, David.
He has an interesting history since from 1988-1996, when he was presumably still vaguely in the mainstream, he was part of an ongoing research project on memory and ageing in Oxford called OPTIMA. The project is still headed by founder Prof David Smith.
December 4, 2007 at 5:46 pm
Dr Aust,
I just wanted to comment and congratulate you on the blog. I’ve read your comments (and enjoyed them!) on other blogs.
Hoping you continue the effort on the blog, and looking forward to much more interesting reading.
Thanks!
January 31, 2008 at 9:33 pm
p.s. I slid a reference to the pyramid paper into my current book chapter. Thanks for bring it to my attention. I would offer a finder fee but, um, as is so often the case I am not being paid. If you come across more rat woo I hope you will post it
February 4, 2008 at 9:00 pm
No fee- ’twas ever thus, Emily.
It always makes me laugh when I see the Alties going on about scientists being BOUGHT AND PAID FOR with huge amounts of PharmaCo cash. In my twenty-odd years’ experience most academics will spill their guts for a sandwich and two pints of beer. Or maybe just one pint. It may be that Movers and Shakers in Medicine are more pricey.
I will keep my eyes peeled for more Alt.Rattery. Talking of animal behaviourism, do you remember the part of Feynman’s Cargo Cult Science speech where he talks about “Mr Young” and the rats-in-mazes experiments from the 30s (almost at the end of the speech)? Do you know if the original work is discussed in detail on the net anywhere? It is a good example of “doing proper control experiments”, so I would be curious to see the original papers.
The other rat behavioural study I always meant to look up some time (but so far haven’t) was Bruce Alexander’s Rat Park work.
February 20, 2008 at 5:27 pm
I don’t know the Young experiment but I am writing another chapter in my book that rants, um, discusses this issue of false standardisation rather than looking at how the animal actually does what it does. Seems like a few commentators keep saying this but it just isn’t getting through. We end up with results we can explain, but the explanation is in fact just wrong. Very depressing. One theory I have is that many rat scientists are insufficiently interested in the ratness of rats and the ratness of how rats do things (i.e. everything a rat does is a rat thing, and best inderstood in that context–not one’s favorite model).
February 20, 2008 at 8:24 pm
Emily wrote: One theory I have is that many rat scientists are insufficiently interested in the ratness of rats and the ratness of how rats do things.
Yes, nicely put. Of course, the big money is in using rats and mice as models for people, so in that context the anthropomorphism is pretty unsurprising when coming from the bioscience / medicine types (like me!).
I am surprised if the animal behaviourists are like that too. I vaguely thought that, post Temple Grandin’s work and all the coverage of it, they would have been wiser to the perils of overly anthropomorphic interpretation.
February 22, 2008 at 6:00 pm
[...] to have an advisory board that is made up of eminent physicians although none is named except for Professor Kim Jobst (he of Q-link). Holfordwatch hopes that some appropriately-qualified people have oversight of the medical, [...]
May 5, 2008 at 4:10 pm
@Andrew Taylor,
Concerning the 200-fold (0.5%) dilution of a homeopathic product. This has been discussed elsewhere, with respect to even more concentrated products. I suggested that the first dilution and succussion makes something homeopathic. However, I asked a colleague who knows far more about the subject “what makes something homeopathic?” She replied “How long is a piece of string?” Several weeks later, having measured many pieces of string, I am still uncertain.