I recently reported this paper for impossible means [link]. A few notes about the process and paper:
I was very pleased with how Patricia Bauer, the editor of Psych Science handled everything. She was super appreciative and kind. And Greg Francis did an excellent job on the analysis and writeup I thought. I have zero complaints about the process. They also handled everything very quickly.
I would like to give more context about this paper.
- Quentin Andre hit the nail on the head by pointing out the effect size issues [link]. d=1.3 is not super likely with a metaphor priming study.
- Some of the means are impossible. Either there were unexplained errors or the summary statistics were generated without any participant data. To be clear, I didn’t expect to see any participant data and none was provided by the authors.
- This paper has two replications. The first replication effort (Firestone & Scholl 2014) was marginally successful but the authors claimed the effect was due to a confound. The second replication effort (Brandt, IJzerman, & Blanken 2014) I found to be more credible than the first and it failed.
The second and third author have some history:
And that is all I have to say about it for now…
Aaron Charlton, PhD, MBA is a marketing professional who currently works in industry for Away Clinic and Away PR and lives in Mesa, Arizona, USA. He is formerly an academic and still takes interest in improving the quality of research in the field of marketing.
Leave a Reply