Randy Ellis
@randalljellis
Host of Metascience Matters; Data Scientist
Massive fraud, ESP, and a roadmap of misconduct - 2011-2012 was a big time for psychology. Diederik Stapel had a career's worth of fraud exposed. Daryl Bem published a study claiming ESP is real. A trio of researchers detailed how to find support for any hypothesis.
The call of metascience - Brian Nosek learned in grad school that science is actually about getting papers and grants, but reading luminaries in the field enlightened him to the solutions to the problems he encountered.
Brian Nosek has led some of the most impactful replication projects in psychology. Hear him tell the story of how he switched his undergrad focus from computer engineering to psychology, and how he ported his computational skills to his newfound research discipline.
What is the future of science? Let's imagine that more research is rigorous, incentives for positive data are fixed, and publish or perish is a thing of the past. What does that world look like? How is the academic career trajectory reimagined? Tim Errington gives his thoughts.
From Chapter 1 of the new Bayesian Workflow book by @statmodeling.bsky.social, @avehtari.bsky.social, @rmcelreath.bsky.social. Two chapters in it already feels like the BDA-SR synthesis the world needed.
What's wrong with peer review? We are obsessed with "narrative", replacing the science with the story. Devaluing the paper in favor of a researcher’s contribution is the first step to fixing this. #science #research #stem #metascience #ethics
Why AI for Science Will Never Work Training AI on scientific literature is a "Garbage In, Garbage Out" trap of 1) false positive data, and 2) lack of null data. Firms are spending millions to redo experiments because they don't trust the literature. #AI #MachineLearning #Science #Research #STEM
Why are drug costs so high? Part of the reason is low replicability rates in preclinical research. Tim Errington breaks down the "clinical vs. preclinical" divide and where different types of institutions fit in the translational ecosystem. #Metascience #Innovation #Academia #DrugDiscovery
Science Has Too Many Pet Theories, Not Enough Falsification Science rewards positive findings, but how do we decide what not to keep pursuing? “Fail faster” research models may make science more reliable. #ReplicationCrisis #Falsification #OpenScience #ScientificMethod #MetaScience
The "magical" science scam Why do scientists always get the results reviewers want? The Center for Open Science is introducing Registered Reports at the revision stage to bring transparency to peer review #science #research #stem #ethics #registeredreports
The need for positive data is the original sin of science. To exist in science, you need grants. To get grants, you need to publish papers. To publish papers, you need positive data. This leads to null data staying in file drawers, and false or misleading positive data being published.