But…but…it worked for me!

What does apple cider debunking, overpronation and cigarette smoking, Oscon supplements for Severs disease and vaccines causing autism have to do with each other?

^^^ that is the final slide in a video from my Critical Thinking Boot Camp. Anyone who blogs about science always get responses and comments with anecdotes about what was written with responses that it either does or does not apply to them. The science either ‘sucks’ or is the ‘greatest thing since sliced bread’ depending on the anecdote! It has now reached the point where I just delete that anecdotal comments on my posts as they contribute nothing of use to the topic under discussion. Steve Novella succinctly summed this up:

It is almost inevitable that whenever we post an article critical of the claims being made for a particular treatment, alternative philosophy, or alternative profession, someone in the comments will counter a careful examination of published scientific evidence with an anecdote. Their arguments boils down to, “It worked for me, so all of your scientific evidence and plausibility is irrelevant.”

In my other blog, I previously litigated all the issues around “anecdotes” and why useless treatment sometimes appear as though they did work. I don’t intend re-litigating the same issues here but develop them further with some examples I have dealt with recently. For background, I refer you to those two posts.

Health Benefits of Apple Cider
My first example comes from a blog post by Melinda Moyer following an article she wrote on the health benefit of apple cider. These three quotes sum up the issue:

After getting hate mail for debunking the health claims of apple cider vinegar, I’m explaining why I rely on science, not rumors.

Last month, I wrote my first Truth Serum column, “What Apple Cider Vinegar Can—and Can’t—Do for Your Health,” which explored what the science says about apple cider vinegar’s supposed health effects. I found that there isn’t much evidence ACV can cure colds, heal acne, help you lose weight, or alleviate heartburn—and that vinegar can sometimes be harmful.

Then came the angry emails and Facebook posts. Readers chided me for interviewing researchers and doctors rather than people who have actually been helped by apple cider vinegar. Others felt the evidence is irrelevant; vinegar works for them, so they’ll keep using it. A few implied that my writing was unbalanced and unfair.

I am sure you can see the issue …

“The Truth about Overpronation”
I and many others have written about the nonsense surrounding “overpronation” and no point litigating them here … again. To me the evidence is clear. The two most recent systematic reviews/meta-analyses show that it is only a small risk factor, but still statistically significant. I and others are forever dealing with what can only be called ‘clowns’ in social media who cherry pick the studies that show its not a risk factor and ignore those that show it is and then resort to the whole gambit of logical fallacies when called out on it. When the evidence is conflicted like that, you need to defer to what the formal systematic reviews and meta-analyses say (however my next blog post will be on how to bias a systematic review and meta-analysis!).

I only raise this now as a number of times recently I have seen this YouTube video used as “evidence” that “overpronation” is not a problem. Firstly, You Tube videos are not evidence of anything! Secondly, whenever you see “The Truth About…” in the title, there is typically less truth in the actual content. Thirdly, yes that video does show Haille Gebrselassie massively “overpronating”. He was a very good elite runner and almost never got an injury. It is held up as evidence that “overpronation” is not a problem and following on from that, foot orthotics can’t possibly work (Dunning-Kruger in full flight). So who a