P-Curve : P-Hacking Your Way To Fame | Part 6 of 6

This is the last video of a series of videos on p-hacking, what it is, and why it’s so dangerous for science. I give a pretty detailed high-level explanation of p-hacking in the first video in this series, so if you’re not familiar with the idea, please have a look there first. I’ll put a link to that video below. But in a few seconds, researchers are motivated to get what’s called a p-value to be below a threshold of .05. If they do that, their findings are considered meaningful and they can typically publish their results. If they don’t, well all their work is largely wasted. And to get those p-values below .05, there are some very dubious and unethical approaches they can take. In this video, we’ll shift away from how p-hacking works to how to detect it using a tool called a p-curve.
Welcome to Data Demystified. I’m Jeff Galak and today we’ll dig deeper into p-hacking so that you can understand how to spot it when you see research results and avoid it when you do the research yourself. In this video we’re going to build the intuition for how a brilliant p-hacking detection tool called the p-curve works and why it’s a powerful tool to thwart this set of bad research practices.
P-Hacking Series Playlist: • P-Hacking
Video 1: P-Hacking Explained (Released on 6/24/2021): • P-Hacking Your Way To ...
Video 2: Dropping Conditions that "Work" (Released on 7/1/2021): • Dropping Conditions th...
Video 3: Multiple Measures Misuse (Released on 7/8/2021): • Multiple Measures: P-H...
Video 4: Covariate Misuse (Released on 7/15/2021): • Covariate Misuse: P-Ha...
Video 5: Selective Stopping Rules (Released on 7/22/2021): • Selective Stopping Rul...
Video 6: P-Curve (Released on 7/29/2021): • P-Curve : P-Hacking Yo...
Link to academic paper about p-curve: papers.ssrn.com/sol3/papers.c...
Link to p-curve tool :www.p-curve.com/
Link to video about statistical significance testing: • Statistical Significan...
Link to video about randomized experiments and causation: • Correlation Doesn't Me...
Link to video about False Positives: • False Positives vs. Fa...
Link to academic paper by Simmons, Nelson and Simonhson: journals.sagepub.com/doi/full...
Link to academic paper by John, Lowenstein, and Prelec: www.cmu.edu/dietrich/sds/docs...
Follow me at:
LinkedIn: / jeff-galak-768a193a
Patreon: / datademystified
Equipment Used for Filming:
Nikon D7100: amzn.to/320N1FZ
Softlight: amzn.to/2ZaXz3o
Yeti Microphone: amzn.to/2ZTXznB
iPad for Teleprompter: amzn.to/2ZSUkNh
Camtasia for Video Editing: amzn.to/2ZRPeAV

[@xxerggher2667]

Thank you for this excellent series. It clarified a lot of things for me.

[@DataDemystified]

Great to hear!

[@MDMAx]

You the mvp. Thank you so very much for your series on this obscure topic!

[@igormiranda8885]

This serie was amazing, it was interesting and fun to watch. Hope we get more series like this in the future :D

[@DataDemystified]

Thank you!

[@organizationalbehavior-ua-8477]

Thanks Really good

[@EliotLu]

Great video series in practical and easy to understand terms. Also the animation was effective and not distracting.

[@DataDemystified]

Glad you enjoyed it!

[@shyama5612]

so now I have to make sure I just cherry pick the p-values to make sure I hv a downward sloping curve? got it! thanks ;)

[@Apanepetepe23]

Well done videos. I very much enjoyed it. What if you are actually doing an explorative study? What would be your best practice recommendation there? I could see it conflicting with your 2nd p-hacking rule - multiple measures.

[@bon12121]

Got your subscription.

[@gabriellandukwe4254]

Thank you so much for this video. It's really helpful and well simplified. Please, how can I cite this?

[@notcharlotte4424]

Thanks for making those helpful videos! Preregistration seems to solve most problems. But if researchers preregister a lot of studies but only report significant ones, does this count as P-Hacking?

[@leshowles749]

Unclear if the P hacking curve is referring to a single study or a particular researchers multiple studies. It would seem that most studies just involve one or two P values. Therefore you wouldn’t use this just looking at one study You would use it looking at a particular researchers multiple studies. Is this correct?

[@DataDemystified]

It’s difficult to p-curve a single study. You’re right that it is typically used across multiple studies