Category: Noise mining & replications
Reviewing Pham’s “feeling the future” paper to illustrate how easy it is to unintentionally p-hack
Context: Michel Pham has responded to Krefeld-Schwalb and Scheibehenne (2022) “Tighter Nets for Smaller Fishes” paper in a way that I believe fails to acknowledge how widespread p-hacking is and how easy it is to fall into that trap. Thus in response I’ve attempted to show how he may have p-hacked his own 2012 paper […]
What kind of p-values should we expect from true effects?
There has been a lot of discussion around what is mathematically, theoretically possible in terms of p-values. If you have .01 < p < .05 is that mathematically possible for true effects? Yes. Can you get the same thing several times in a row? Mathematically speaking it’s possible, even if unlikely. But I would like […]
2022 marketing metascience year in review
First, definitely check out the 2021 marketing metascience year in review if you haven’t yet. This is an update of that review. Let’s get into it! Just like 2021, 2022 has brought a deluge of new replications and bias studies, which is great because there had been very little effort to test the trustworthiness of […]
You are right that we shouldn’t expect marketing studies to replicate (but I disagree about the reason)
Some deep thinkers in marketing have postulated that perhaps marketing studies are not replicable because of the ever-shifting context around consumption. This is an interesting and valid theory that has some merit. Certainly, the context has changed. There has been a tremendous shift in how we consume and what media we are exposed to in […]
Replications in Marketing: Myth and Reality
Third-party replication is the foundation of good science. Without replication, how can we know if a scientific finding is even true? Moreover, if an entire field loses its sanity and commences in the wide-scale production of false knowledge, how would we know without replication? In order to help emphasize the usefulness of replications in marketing, […]
Updating your CB (Consumer Behavior) course to reflect the replication crisis
According to Evanschitzky et al. (2007), teachers should ignore findings until they have been replicated. Unfortunately, only a very small portion of all marketing studies have withstood the scrutiny of direct, preregistered replication. Moreover, a lot of things came to light in 2021 that should give us pause before we blindly endorse the collective works […]
2021 marketing meta-science year in review
Okay so we are starting to learn that there could be some issues with the way that we are doing research currently. That’s okay. It’s part of the process. We can take a hard look, make changes, and come out better for it. Specifically, it looks like there may be a lot of noise mining […]
